Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 4 of 4
  1. #1
    New Coder
    Join Date
    Jan 2013
    Posts
    17
    Thanks
    6
    Thanked 0 Times in 0 Posts

    PHPMyAdmin Large File Upload Issue

    Hi Everyone, I hope someone can advise here - we have an opportunity to work with a large company who need data extracting from a database with 700,000 records in it. We have a meeting on Friday which could be make or break for our company.

    We have been trying to import an 80 MB csv file into a MySQL database using phpmyadmin and it's taking a very long time to upload the file. We have tried every variant of csv file that we can think of and they all either take ages to upload or just crash. When we have managed to upload a file, a simple query takes 15 minutes or more to run.

    The table has 22 columns, are we expecting too much from phpmyadmin and mySQL or should this be a simple job for it? Any advice would be greatly appreciated.

  • #2
    God Emperor Fou-Lu's Avatar
    Join Date
    Sep 2002
    Location
    Saskatoon, Saskatchewan
    Posts
    16,987
    Thanks
    4
    Thanked 2,660 Times in 2,629 Posts
    Yep, 80MB is big. That could be rejected by PHP itself. You should be able to configure these directives in PHP.ini as well. You need to look for POST_MAX_SIZE, UPLOAD_MAX_FILESIZE, MEMORY_LIMIT, and set the set_time_limit to increase the timeout. These all need to be larger than the file, and POST_MAX_SIZE should be > UPLOAD_MAX_FILESIZE (and MEMORY_LIMIT needs to be > POST_MAX_SIZE). And these are just the limitations with the PHP itself, I haven't a clue if phpmyadmin has any of its own.

    All and all, why not just execute a command line call to the mysql dbms and provide it the file that way?
    PHP Code:
    header('HTTP/1.1 420 Enhance Your Calm'); 

  • Users who have thanked Fou-Lu for this post:

    sitechooser (03-06-2013)

  • #3
    New Coder
    Join Date
    Jan 2013
    Posts
    17
    Thanks
    6
    Thanked 0 Times in 0 Posts
    Thanks for the response and advice. We tried all of your suggestions but in the end I think phphmyadmin as the weak link. MySQL workbench came to the rescue and all our slow upload and query issues vanished. If anyone else if having these issues I would highly recommend the switch.

  • #4
    God Emperor Fou-Lu's Avatar
    Join Date
    Sep 2002
    Location
    Saskatoon, Saskatchewan
    Posts
    16,987
    Thanks
    4
    Thanked 2,660 Times in 2,629 Posts
    Quote Originally Posted by sitechooser View Post
    Thanks for the response and advice. We tried all of your suggestions but in the end I think phphmyadmin as the weak link. MySQL workbench came to the rescue and all our slow upload and query issues vanished. If anyone else if having these issues I would highly recommend the switch.
    Yep, there's really no need to even use the phpmyadmin.
    Although, I have installed it within the past few months on my home machine just to see what people are talking about when they have questions about it. It seems to be great for minor modifications and overall viewing, but with lack of being able to do easily view the related data, I may as well just stick with the command line. There was also one structural change I couldn't do from the phpmyadmin. It was removal of something, not a column or anything like that, but I can't remember what it was. Had to do it from the command line.
    PHP Code:
    header('HTTP/1.1 420 Enhance Your Calm'); 


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •