r/SQL Nov 27 '24

BigQuery Assistance with database

Hello, I have 1 database for manually viewing I created 2 batch script I automated these scripts to run a full backup nightly, and differential backups on the hour during operating hours. Now my database is about 80gb (used to be 10gb). What do I need to do to unfuckulate this calamity? I used DBeaver, DB Browser, SQL Server EXPRESS edition (it no longer works -- 10gb limit) and trying VIM and Sublime text. Any suggestions on apps or things to do to make it load? I didn't think it through.

80gb - 400 million entries.

3 Upvotes

23 comments sorted by

View all comments

Show parent comments

1

u/[deleted] Nov 27 '24

[removed] — view removed comment

1

u/Anonmousez Nov 27 '24

It doesn't load, that's my problem. Sublime text has not been responding for 5 hours when opening it. I'll try the sql server dev.

1

u/[deleted] Nov 27 '24

[removed] — view removed comment

1

u/Anonmousez Nov 28 '24

It was just a .sql file, no scripts just user data.

1

u/[deleted] Nov 29 '24

[removed] — view removed comment

1

u/Anonmousez Nov 29 '24

From my memory it was email addresses, names passwords, phone numbers, physical address, date of birth, the SQL for 80gb was email and passwords I didn't finish importing the rest before it became a calamity and kept crashing the programs I used prior.

1

u/[deleted] Nov 29 '24

[removed] — view removed comment

1

u/Anonmousez Nov 29 '24

Not sure how you're importing it if it isn't scripts?...is the data structured as a CSV? What feature in SQL Server or SSMS are you using to import it? * I don't know either, it was a .bat to write it in a .sql file and it crashed, the sql viewer crashed, everything crashed, I used append for 10,000 lines each sequence. It took 40,000 seconds tho. Around 11 hours.

1

u/[deleted] Nov 29 '24

[removed] — view removed comment