Kinook Software Forum

Go Back   Kinook Software Forum > Ultra Recall > [UR] General Discussion

Reply
 
Thread Tools Rate Thread Display Modes
  #1  
Old 05-19-2007, 10:43 AM
Jon Polish Jon Polish is online now
Registered User
 
Join Date: 07-21-2006
Posts: 391
Import failure

I know this problem has been mentioned before, but I would like some clarification as to its cause, limitations and work-around.

Importing and exporting has been aggratating problems for me. I do both routinely and both procedures involve large amounts of information. I have been told that URp is simply not designed to handle large imports and exports, but I do not know what the limits are. Besides, with other programs able to do both effortlessly, I fail to see why this should not be addressed in this otherwise very impressive product.

Knowing that imports consume 100% CPU usage and take FOREVER to boot, I choose (inconveniently) to start imports on Friday evenings. URp displays a dialogue indicating that it is working, but the next day, nothing is imported and there is no error message.

The current failure involves a note delimited rtf that is approximately 24 mb. Other files have failed that were significantly smaller, but contained more delimiters. For example, one failure was with a 6 mb txt file containing over 20,000 delimited notes.

It is far too time consuming to get information in and out of UR. This just adds insult to injury.

Does anyone have any advice? It would be greatly appreciated

Jon
Reply With Quote
  #2  
Old 05-21-2007, 11:25 AM
kinook kinook is online now
Administrator
 
Join Date: 03-06-2001
Location: Colorado
Posts: 6,034
If there any way you could provide an RTF file and details on how you imported that result in this problem (ZIP and send to support@kinook.com)? Thanks.
Reply With Quote
  #3  
Old 05-21-2007, 11:43 AM
Jon Polish Jon Polish is online now
Registered User
 
Join Date: 07-21-2006
Posts: 391
The contents of the rtf file are confidential, so I cannot provide them. Sorry.

However, I can provide details on the import attempt.

1. Created a folder under the root (My Data) and named it 2007-05
2. File | Import (A Text of Rich Text (RTF) File
3. Browse to the file to be imported
4. Click String
5. Check Match case and Remove String
6. Choose "Selected Item in Data Explorer Pane"
7. Uncheck "Create logically linked..." and check "Automatically skip unreachable URLs."
8. Click "Finished."

A dialogue saying "Please Wait" pops up. After a very, very, very long time it goes away. Nothing was imported.

Jon
Reply With Quote
  #4  
Old 06-01-2007, 09:20 AM
kinook kinook is online now
Administrator
 
Join Date: 03-06-2001
Location: Colorado
Posts: 6,034
I crufted up a 25MB RTF file with about 25,000 delimited items and imported in the manner specified. It did take a while to import, but it always completed successfully (all items imported) and only consumed 50% CPU (on a dual-core AMD system) while importing.
Reply With Quote
  #5  
Old 06-01-2007, 09:40 AM
Jon Polish Jon Polish is online now
Registered User
 
Join Date: 07-21-2006
Posts: 391
Thank you for testing.

I'm stumped. Mine definitely does not work, although it initially appears to. That is, I see the dialogue, which remains on screen while UR chugs along. After that, nothing. No error message appears and the imported items do not appear in the database. This is repeatable.

As for CPU usage, I have tried it on a dual core system. I confirm the 50% usage. But if my current single core systems can run Vista Premium, why should I have to upgrade my hardware to use UR?

Jon
Reply With Quote
  #6  
Old 06-01-2007, 10:08 AM
kinook kinook is online now
Administrator
 
Join Date: 03-06-2001
Location: Colorado
Posts: 6,034
It is odd. Is there an 'Import document(s) under <item name>' item at the top of the Undo toolbar drop-down afterwards? Does searching on items with a Date Created of today show anything?

You could try lowering the process priority (run taskmgr, right-click on ultrarecall.exe -> Set Priority -> Below normal [or Low]) before importing. But if you're importing that much data regularly, you probably want the fastest dual- or quad-core system you can find.
Reply With Quote
  #7  
Old 06-01-2007, 10:12 AM
Jon Polish Jon Polish is online now
Registered User
 
Join Date: 07-21-2006
Posts: 391
Quote:
Originally posted by kinook
Is there an 'Import document(s) under <item name>' item at the top of the Undo toolbar drop-down afterwards? Does searching on items with a Date Created of today show anything?
No to the first and second questions.

Jon
Reply With Quote
  #8  
Old 06-04-2007, 02:15 PM
Jon Polish Jon Polish is online now
Registered User
 
Join Date: 07-21-2006
Posts: 391
Kinook:

I have put together an example of a file I am trying unsuccessfully to import. Much of the file has been converted to gibberish, but it will demonstrate the problem I am experiencing. The steps I take to import this file (and others like it) are listed above. I will email this to you at support@kinook.com.

This file is a text only export of approximately 29,000 emails. The delimiter is ==END==

Thank you.

Jon
Reply With Quote
  #9  
Old 06-05-2007, 01:37 PM
kinook kinook is online now
Administrator
 
Join Date: 03-06-2001
Location: Colorado
Posts: 6,034
Thanks, I was able to reproduce the silent failure with your test file, and the main download has been updated with a patch for that problem. But it will be faster to import that large of file via CSV import rather than text/RTF. I've attached a script which will convert email.txt to CSV format as email.txt.csv, which can then be imported via the CSV option (uncheck 'First row contains field names' and map Field 1 -> Item Text).
Attached Files
File Type: zip convertcsv.zip (787 Bytes, 2131 views)
Reply With Quote
  #10  
Old 06-05-2007, 01:56 PM
Jon Polish Jon Polish is online now
Registered User
 
Join Date: 07-21-2006
Posts: 391
Holy (never mind, I don't want to get banned)!

Importing as a csv works much better. Not blazingly fast, but I can live with this. Thank you so much.

With regard to the fix for the silent failure, can you tell me precisely what this fixes? Do you mean that I can now successfully complete an import of similar files or do you mean that UR will notify me of its failure to import these files?

Jon
Reply With Quote
  #11  
Old 06-05-2007, 02:15 PM
kinook kinook is online now
Administrator
 
Join Date: 03-06-2001
Location: Colorado
Posts: 6,034
Quote:
Originally posted by Jon Polish
With regard to the fix for the silent failure, can you tell me precisely what this fixes? Do you mean that I can now successfully complete an import of similar files or do you mean that UR will notify me of its failure to import these files?
It will no longer silently fail (do nothing) when loading a large text file like that, and it should successfully import the file (eventually).
Reply With Quote
  #12  
Old 06-05-2007, 02:43 PM
Jon Polish Jon Polish is online now
Registered User
 
Join Date: 07-21-2006
Posts: 391
Quote:
Originally posted by kinook
It will no longer silently fail (do nothing) when loading a large text file like that, and it should successfully import the file (eventually).
OK, that is good.

My only wish is that the overall performance be improved. Thank you for fixing this very annoying problem for me.

Jon
Reply With Quote
Reply

Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



All times are GMT -5. The time now is 11:59 AM.


Copyright © 1999-2023 Kinook Software, Inc.