Submitted by Anonymous on 2008/11/30 07:42
I'm going to start dumping all of my data into InfoQube. What is the best way, one big file or several smaller ones? My main concern is how large can the file get before one would start noticing delays as the file loads? Is there a limit in file size with InfoQube? Can the gantt charts work with more than one grid in a file? I hope you are able to add the ability to use weekends with the gantt chart. Sorry if the questions are answered elsewhere I couldn't find them.

Comments

Hi Tholt,
 
1- What is the best way, one big file or several smaller ones?
 
 
It depends. Of course, a bigger file will tend to slow down processing a bit.
I only have one database (well... 2 : one for my stuff, and one for the mantis bug tracking system). Right now I have close to 7000 items, lots of text and images (a year worth of web clips, studies, etc.). Database is close to 150 mb (compacted). Opening "normal" grids take usually take a few seconds (3-6).  The "all items" grid (source is empty, no filter...) is the slowest. It takes, yes, a few second -- maybe 12-13 sec. But after that, there's no problem.
 
PIerre is  of course aware of the importance of performance. I don't know if that is the quickest we can expect, only him can answer. But I'd say that in general , the database information processing is fairely fast, even when large.
 
In general, I'd say that unless you don't mind having several DB open at the same time, unless you know perfectly what would go where, unless you don't need to have the different databse info to relate with each other (i.e : want to divide everything between work and personal like (for example) or encrypt some files and not others), it's usually easier to work with only one database... or only a few for very very specific purposes... Just easier to find your items, and create links, relationships and analysis.
 
 
2- Is there a limit in file size with InfoQube?
 
Yes, but this limit will vary as users will be able to use different backends for their database. Right now InfoQube current database backend is based on JET 4.0 (.mdb, Access format), and the limit is 2gb (if I'm not mistaken). But when/if Pierre keeps working on the SQL Server version (is that it...or some mySQL format ?), it'll be a different story.
 
3- Can the gantt charts work with more than one grid in a file?
 
Yes, you can enable the gantt chart for any grid you want.
 
 
4- I hope you are able to add the ability to use weekends with the gantt chart.
 
I think so.  Pierre said in [node:164,title=""] :
 
[quote=Pierre_Admin]
Gantt: [...]  I'll add the possibility to select working days for the Gantt
[/quote]
 
 
Hope that helps.
 
 

Anonymous

2008/11/30 20:24

Permalink

Thank you for the reply, the answer was very helpful. As soon as the calendar is finished and the Gantt charts it will be just about perfect. At first I was just looking for a single pane outliner. InfoQube does that and so much more. What a tremendous find this software is. Thanks again for the answers.

Pierre_Admin

2008/11/30 21:31

Permalink

[quote=Armando]
It depends. Of course, a bigger file will tend to slow down processing a bit.
I only have one database (well... 2 : one for my stuff, and one for the mantis bug tracking system). Right now I have close to 7000 items, lots of text and images (a year worth of web clips, studies, etc.). Database is close to 150 mb (compacted). Opening "normal" grids take usually take a few seconds (3-6).  The "all items" grid (source is empty, no filter...) is the slowest. It takes, yes, a few second -- maybe 12-13 sec. But after that, there's no problem.[/quote]
  1. I'm looking at an alternative way of reading data from the database, which should speed things up significantly for large databases
  2. You may want to remove the local copy of your MHT files as these take up large amount of space. To find the large items:
    1. Open the ItemHTMLSize field in the scratchpad grid, sort by ItemHTMLSize Desc
    2. For each large item, you can, in the HTML pane, do: Menu>Edit>Delete Database Copy
    3. Once finished, you can compact
    4. This has no real impact as full text search will still work as before. I'll most likely add an option as to whether to keep a cache in the database or not

Armando

2008/12/01 21:46

Permalink

Thanks for all that info Pierre!