My favorites | Sign in
Logo
                
New issue | Search
for
| Advanced search | Search tips
Issue 610: [REQ] Export redesign/rewrite features
11 people starred this issue and may be notified of changes. Back to list
 
Reported by stuart02, Mar 28, 2010
This issue will be used to track the progress, all feature requests and eventually bugs related to the current export redesign. As 
such the following issues have been merged into this one in order to try and keep everything in one place:

 Issue #119 : The option to control use of hexadecimal for BLOB
 Issue #187 : Import & export don't support the same formats
 Issue #492 : Export MySQL dump should divide up inserts into one insert statement per table row
 Issue #507 : The option to specify if the UTF-8 BOM is used for MySQL dumps

Apart from the above, feature requests with no associated issue include:

+ The ability to set whether the structure and/or content is included in MySQL dumps on a per-table basis in addition to the 
current 'global' basis.

The branch under which development is taking place is:

http://code.google.com/p/sequel-pro/source/browse/#svn/branches/export-redesign

Any other feature requests should be added as comments on this issue.
Comment 1 by stuart02, Mar 28, 2010
 Issue 119  has been merged into this issue.
Comment 2 by stuart02, Mar 28, 2010
 Issue 187  has been merged into this issue.
Comment 3 by stuart02, Mar 28, 2010
 Issue 492  has been merged into this issue.
Comment 4 by stuart02, Mar 28, 2010
 Issue 507  has been merged into this issue.
Comment 5 by stuart02, Mar 28, 2010
 Issue 566  has been merged into this issue.
Comment 6 by stuart02, Mar 30, 2010
 Issue 261  has been merged into this issue.
Comment 7 by stuart02, May 04, 2010
 Issue 662  has been merged into this issue.
Comment 8 by stuart02, May 14, 2010
 Issue 672  has been merged into this issue.
Comment 9 by stuart02, May 24, 2010
r2244 merges the export redesign branch back into trunk and although it is not yet complete it does implement 
the majority of these requests.
Comment 10 by teebo22, May 26, 2010
SQL export is now very slow compared to previous versions.
The new features are "nice" but the export of a 300MB DB use to take 3 or 4min and now takes over 15min.
Comment 11 by serpicolugnut, May 26, 2010
First of all, the new export window is kind of confusing. It took me a couple of clicks to figure out to uncheck S & 
D columns I had to check on the boxes on the side, not the global check/uncheck boxes.

Second, upon selecting items for export, I get the spinning beachball of death for a few minutes (and this is just 
for exporting one relatively small table), and if the app recovers, the export takes a super long time.

I understand that using nightlies means living on the bleeding edge, but I'd say this feature wasn't quite ready for 
public consumption. I've had to go back to a week old build.
Comment 12 by stuart02, May 26, 2010
Hi serpicolugnut,

Thanks for taking the time to test it out and provide feedback.

I've identified the cause of the beachballing, but out of curiosity, can I ask how many tables there were in the 
database that you experienced the issue? I'm assuming it was in the hundreds as the number of tables is the 
root cause.

Cheers

Stuart
Comment 13 by stuart02, May 26, 2010
Rowan has kindly fixed the SQL export's progress indicator as well as the use of incorrect extension when 
compressing dumps in r2253 and the beachballing issue when selecting/deselecting tables on the export dialog 
has been fixed in r2254.
Comment 14 by teebo22, May 27, 2010
Hello Stuart02,

The SQL export is as fast as before.  197 tables in a couple of minutes.
I find the new export interface relatively useful and easy to use.
I have not tested the other export formats.
Comment 15 by serpicolugnut, May 28, 2010
Stuart - I'm trying to export just one table, albeit a larger (30MB or so) one. However, with only 1 table selected 
(and both Structure and Drop Table turned off in the export window), it still tries to export every table in the 
database (at least, the progress indicator goes through each table). The final output reveals that both Structure 
and Drop Table Syntax are included in the export, even though I've unchecked them in the Include sidebar, which 
is the only way apparently to turn them all off (my database has hundreds of tables).

So, it looks like the bug(s) are:

1) Unchecking "Structure" and "Drop Table Syntax" from the export sidebar just remove those options from the 
list of tables that can be exported, but don't actually remove them from being exported. There needs to be a way 
to check/uncheck all for the Structure and Drop Table Syntax columns like there is for content.

2) You can't name your files, and since Sequel Pro now names every file with a format of Y-M-D, multiple exports 
in the same day produce files that overwrite the previously written file that day. Not good.

Hope this helps.
Comment 16 by stuart02, May 31, 2010
Hey serpicolugnut,

Thanks for the feedback, I appreciate you taking the time to provide it.

With regard to the points you made, I've also noticed issue (1) and am currently working on fixing it. It seems that 
the complex interface validation is causing the problem. For issue (2) see my response to  issue #712  that you 
logged.

Thanks again.

Cheers

Stuart 
Comment 17 by rowanb, Jun 06, 2010
r2289 addresses the "Structure" and "Drop Table Syntax" interaction - the checkboxes on the right are now 
respected, and when they are enabled the select/deselect all toggles will affect *all* checkboxes.
Comment 18 by rowanb, Jun 07, 2010
r2291 improves the SQL exporter further, resolving a number of issues with more recent code changes on trunk - 
view, procedure and function exports should work correctly again, triggers should be exported even if content is 
disabled, and a number of other tweaks have been made.

That should resolve all remaining issues with the actual generated SQL, and also tweaks CSV formats.
Comment 19 by stuart02, Jun 18, 2010
Still to be implemented/fixed:

+  Issue #742 
+ Fix the resizing of UI controls when both the custom filename and advanced options views are displayed.


Comment 20 by di...@progressnowaction.org, Jun 29, 2010
The export dialog seems to inconsistently remember things like the export path and the filename tokenization, especially when switching between databases.

It seems every time upon showing the dialog after switching databases I have to reset the path from the default (the desktop), and about half the time I have to re-do the filename tokenization.

Those should be stickier. The Apple HI guidelines are pretty clear about the types of things that should default to their "last used" state. I'd refer to those guidelines when evaluating how that dialog should behave.
Comment 21 by stuart02, Jul 02, 2010
Preserving the selected export path has been improved in r2368 and r2394.
Comment 22 by el...@tele-concept.com, Jul 08, 2010
Every time I set the Customize Filename field on CSV export options, there are 2 files that are generated, the one that I've asked for, and another file with null string concatenated to its end, see screenshot.
Screen shot 2010-07-08 at 8.53.59 PM.png
66.7 KB   View   Download
Comment 23 by stuart02, Jul 08, 2010
Hi,

Thanks for the report. Can I ask what revision you're using?

Cheers
Comment 24 by stuart02, Jul 09, 2010
Still to be implemented/fixed:

+  Issue 742 
+  Issue 747 

+ Convert our XML output format to standard MySQL XML format. See:

http://dev.mysql.com/doc/refman/5.1/en/mysqldump.html#option_mysqldump_xml
Comment 25 by el...@tele-concept.com, Jul 11, 2010
Just downloaded the latest Nightly build 2450, and tried it again and it still have duplicate files. so I guess the latest build has this problem too.
Eldad.
Comment 26 by rowanb, Jul 16, 2010
eldad - thanks for reporting that; it was an issue with Filtered Results exports, I believe.  Should be fixed as of r2462 :)
Comment 27 by stuart02, Jul 18, 2010
Thanks Rowan :)
Comment 28 by avenjamin, Jul 24, 2010
Just a reminder for you to add some "smarts" to the export sheet so that when you're working in the query editor and you select Export it selects "Query Results" instead of "Tables".
Comment 29 by stuart02, Jul 25, 2010
@avenjamin: Implemented in r2476
Comment 30 by rdshedd, Jul 27, 2010
I'm running the CAalpha4 build.  I tried to run an export yesterday and it allowed me to set the options (SQL export) and initiate the export.  Then the status window opened, stated "Writing..." created the file (of 0 byte size) and just sat there.  I hit cancel and restarted the export multiple times, but it didn't help.  Then I quit and restarted CAalpha4, and then it ran the export as expected.
Comment 31 by rdshedd, Jul 27, 2010
Also, CAalpha4 doesn't seem to prompt you if you're going to overwrite a file.  Seems like that's something that's missing....
Comment 32 by stuart02, Jul 28, 2010
@rdshedd: This is a known issue, see  issue #742 .

Comment 33 by stuart02, Aug 12, 2010
 Issue #742  has been fixed in r2520.
Comment 34 by stuart02, Aug 26, 2010
Still to be fixed:

+ Look into custom filename issues
+ Re-enable Gzip and Bzip2 file compression as well as CSV and XML file headers for files that are overwritten. See r2581.
Sign in to add a comment

Powered by Google Project Hosting