Issue with Continuous Storage Upload in SQLite Cloud - Data Size Discrepancy

[Orrv2904]

Hello,

I am experiencing an issue with the storage usage on SQLite Cloud. Although my local SQLite database file is only 3 MB in size, the "Storage" section in the dashboard keeps increasing without stopping. It appears that the system is continuously uploading data, but the database file itself hasn't changed in size.

Here are some details:

1. The database file I uploaded is approximately 3 MB in size.
2. The storage usage in the dashboard keeps increasing, surpassing the 1 GB limit, even though the actual database file remains small.
3. I am using the following method to sync data from my local SQLite database to SQLite Cloud, and I am unsure why this issue is occurring: this is my script to upload my local database to SQLite Cloud.

Could you please help clarify why the storage is increasing unexpectedly? Is there a potential issue with how the data is being uploaded or synced to the cloud?

Any guidance would be greatly appreciated!

Thank you in advance.

import sqlitecloud
import sqlite3
from sqlite3 import OperationalError

def sync_cloud_with_local(local_db_path, cloud_connection_str):
    # Conectar a SQLite Cloud
    cloud_conn = sqlitecloud.connect(cloud_connection_str)
    cloud_cursor = cloud_conn.cursor()
    
    # Conectar a la base de datos local
    local_conn = sqlite3.connect(local_db_path)
    local_cursor = local_conn.cursor()
    
    try:
        # Paso 1: Deshabilitar restricciones y limpiar la base de datos en la nube
        cloud_cursor.execute("PRAGMA foreign_keys = OFF;")
        
        # Obtener todas las tablas existentes en la nube
        cloud_cursor.execute("SELECT name FROM sqlite_master WHERE type='table' AND name NOT LIKE 'sqlite_%';")
        cloud_tables = [row[0] for row in cloud_cursor.fetchall()]
        
        # Eliminar todas las tablas de la nube
        for table in cloud_tables:
            try:
                cloud_cursor.execute(f"DROP TABLE IF EXISTS {table};")
            except OperationalError as e:
                print(f"Error eliminando tabla {table}: {str(e)}")
        
        # Paso 2: Copiar esquema y datos desde la base local
        # Obtener todas las tablas locales en orden de creación
        local_cursor.execute("SELECT name, sql FROM sqlite_master WHERE type='table' AND name NOT LIKE 'sqlite_%' ORDER BY rowid;")
        
        for table_name, create_sql in local_cursor.fetchall():
            try:
                # Crear la tabla en la nube
                cloud_cursor.execute(create_sql)
                
                # Copiar los datos
                local_cursor.execute(f"SELECT * FROM {table_name};")
                rows = local_cursor.fetchall()
                
                if rows:
                    # Obtener nombres de columnas
                    local_cursor.execute(f"PRAGMA table_info({table_name});")
                    columns = [col[1] for col in local_cursor.fetchall()]
                    
                    # Crear consulta de inserción
                    placeholders = ', '.join(['?'] * len(columns))
                    insert_sql = f"INSERT INTO {table_name} ({', '.join(columns)}) VALUES ({placeholders})"
                    
                    # Insertar datos
                    cloud_cursor.executemany(insert_sql, rows)
                
                print(f"Tabla {table_name} sincronizada: {len(rows)} registros")
            
            except OperationalError as e:
                print(f"Error sincronizando tabla {table_name}: {str(e)}")
        
        # Rehabilitar restricciones
        cloud_cursor.execute("PRAGMA foreign_keys = ON;")
        
        # Confirmar cambios
        cloud_conn.commit()
        print("\nSincronización completa exitosa!")
    
    finally:
        # Cerrar conexiones
        local_conn.close()
        cloud_conn.close()

# Configuración
LOCAL_DB_PATH = r"localpath"
CLOUD_CONN_STR = "connection string"

# Ejecutar sincronización
sync_cloud_with_local(LOCAL_DB_PATH, CLOUD_CONN_STR)

[danielebriggi]

Can you please write us from the Dashboard to provide us more details on your specific case? You can click on the Question mark on the top right of the page and click on "Contact us".
Thank you

[Orrv2904]

I have already sent the mail, with the subject Unexpected Storage Growth in Dashboard (Local Backup Sync)