Not enough memory to create a database

This forum is for eXpress++ general support.
Message
Author
User avatar
Eugene Lutsenko
Posts: 1649
Joined: Sat Feb 04, 2012 2:23 am
Location: Russia, Southern federal district, city of Krasnodar
Contact:

Not enough memory to create a database

#1 Post by Eugene Lutsenko »

Not enough memory to create a database.

When you open a small database CSV, then you can create a DBF file for conversion. But when the CSV file is large, assigning the structure of the database to be created in the array is obtained an empty array. Is there any command in order to free up the memory within the program? For example for arrays
Last edited by Eugene Lutsenko on Sun Oct 22, 2017 10:31 am, edited 1 time in total.

Victorio
Posts: 621
Joined: Sun Jan 18, 2015 11:43 am
Location: Slovakia

Re: Not enough memory to create a database

#2 Post by Victorio »

Hi, Eugene,

How size is CSV file ?
I also converting txt files to database, but when TXT file is larger than about 1 - 1.5GB, then it is problem.
Because I break file to smaller parts (about 100Mbytes) and read it separately.
Read one part, save to dbf, close this txt part and read other.
This works for me fine, without risk of memory exhaust.

User avatar
Eugene Lutsenko
Posts: 1649
Joined: Sat Feb 04, 2012 2:23 am
Location: Russia, Southern federal district, city of Krasnodar
Contact:

Re: Not enough memory to create a database

#3 Post by Eugene Lutsenko »

The size of the CSV file is just 670 MB. I was hoping that it will be possible to introduce it into dbf file all at once. In parts it seems to work, but I do not like

bwolfsohn
Posts: 648
Joined: Thu Jan 28, 2010 7:07 am
Location: Alachua, Florida USA
Contact:

Re: Not enough memory to create a database

#4 Post by bwolfsohn »

create the database from a portion of the file.

then you can "append from delimited"
Brian Wolfsohn
Retired and traveling around the country to music festivals in my RV.
OOPS.. Corona Virus, so NOT traveling right now...
http://www.breadmanrises.com
FB travel group: The Breadman Rises

User avatar
Eugene Lutsenko
Posts: 1649
Joined: Sat Feb 04, 2012 2:23 am
Location: Russia, Southern federal district, city of Krasnodar
Contact:

Re: Not enough memory to create a database

#5 Post by Eugene Lutsenko »

From the small part I made when I was debugging. I usually am debugging on small amounts of data and faster to check. And then, when I took a real base, it turned out that it's not working. In Total Commander you can cut the file into parts, but not more than 1000 parts. But portions were too big. Now it turns out it is necessary to cut the part into pieces... and so until until you earn

User avatar
Eugene Lutsenko
Posts: 1649
Joined: Sat Feb 04, 2012 2:23 am
Location: Russia, Southern federal district, city of Krasnodar
Contact:

Re: Not enough memory to create a database

#6 Post by Eugene Lutsenko »

And Roger not have a program that converts a very large (giant) CSV files to DBF?

bwolfsohn
Posts: 648
Joined: Thu Jan 28, 2010 7:07 am
Location: Alachua, Florida USA
Contact:

Re: Not enough memory to create a database

#7 Post by bwolfsohn »

append from "csvfilename.csv" delimited will work with any size .csv, subject to the size limitations on .dbf files.
Brian Wolfsohn
Retired and traveling around the country to music festivals in my RV.
OOPS.. Corona Virus, so NOT traveling right now...
http://www.breadmanrises.com
FB travel group: The Breadman Rises

User avatar
Eugene Lutsenko
Posts: 1649
Joined: Sat Feb 04, 2012 2:23 am
Location: Russia, Southern federal district, city of Krasnodar
Contact:

Re: Not enough memory to create a database

#8 Post by Eugene Lutsenko »

bwolfsohn wrote:append from delimited will work with any size .csv, subject to the size limitations on .dbf files.
It is clear that the dbf file is < 2 GB. And could You explain to me more detail how to do this?

May be somebody knows where can I download CSV->DBF converter, which can do that?


User avatar
Auge_Ohr
Posts: 1405
Joined: Wed Feb 24, 2010 3:44 pm

Re: Not enough memory to create a database

#10 Post by Auge_Ohr »

Eugene Lutsenko wrote:May be somebody knows where can I download CSV->DBF converter, which can do that?
what is your Problem ?

Code: Select all

USE MyDBF EXCLUSIVE
APPEND FROM XYZ.TXT DELIMITED WITH ";"
greetings by OHR
Jimmy

Post Reply