Entries deleted inside Cockpit are retained in API

chechoribero · May 19, 2021, 10:13pm

I ran into an issue the other day when trying to delete a large number of entries inside a collection. I used the batch delete option to delete the entries I didn’t need but they still show up when calling the API. Does anyone have any clues on how to fix this?

MarcTabaries · July 13, 2021, 1:09pm

Indeed, I had the same problem.

At first I thought that by deleting the cache (in settings/system > cache) this would be fixed … but it is not.

I had a singleton named Contact. With data in it (title, content). I deleted the singleton structure and recreated it with the same name and data type … when calling the URI of the new singleton, the data from the old was there again!

The only solution I found was to delete the files that end in .sqlite in /storage/data. The structure of singletons / collections is preserved, because this information is stored in /storage/singleton, /storage/collections, /storage/forms, … ! So remember to also delete the structure directly in the FTP or via Cockpit if it is a problem of data and structure.

Of course the data will be lost … but you will be able to recreate them from scratch (with the good structure).

Be careful, by doing this you will be logged out of Cockpit. The user account used will no longer be recognized. It makes sense as you will have deleted all the data. This could be avoided if I knew which file the user accounts were stored in. To solve the problem, you must restart the installation procedure (by going to site.com/install) … an admin / admin account will be automatically recreated again.

If you’re worried about breaking everything, test locally or on another server.

This is not practical. I don’t know why Cockpit behaves like this. Is this a bug?

abernh · July 27, 2021, 9:54pm

These seem to be 2 different things.

1) (Batch) deleting entries from collections

I was not able to reproduce this on the latest next branch.
I tried creating and deleting entries using the batch functionality, querying the api inbetween but it always showed the correct entries. Never deleted ones.

@chechoribero do you have a sure set of steps to re-create the issue? How many entries does your collection have? How many did you delete?
Did you test if refreshing the cache solves the issue? (still, this would be no solution, only an indicator in which direction a fix might be needed)

2) Deleting singletons

When a singleton is deleted, there is actually nothing deleted from the DB but only the singleton spec file is deleted

github.com

agentejo/cockpit/blob/568b0124352f6d27df359e8c19a70d2dd1961e87/modules/Singletons/bootstrap.php#L103

    
      
                  return false;
              }
          
          
    return isset($data['_id']) ? $this->updateSingleton($name, $data) : $this->createSingleton($name, $data);
          },
          
          
'removeSingleton' => function($name) {
          
          
    if ($singleton = $this->singleton($name)) {
          
          
        $this->app->helper('fs')->delete("#storage:singleton/{$name}.singleton.php");
          
          
        $this->app->trigger('singleton.remove', [$singleton]);
                  $this->app->trigger("singleton.remove.{$name}", [$singleton]);
          
          
        return true;
              }
          
          
    return false;
          },

So if a new singleton is created with the same name and fields the old data entries will still be there. Deleting the cache does not change anything about that.

This is not ideal and I pushed a PR for that - so this might be fixed in the future.

Topic		Replies	Views
API Returns fields that have been removed from collection Support	5	1889	June 12, 2019
Update collection and singleton via api Support	9	4268	February 9, 2023
How to remove fields that doesn't exist after removing them from API? Support	6	2184	March 13, 2020
Bug or intended behavior? MongoDB + Cockpit Docker fails to restore data after Docker restart Support	0	668	July 2, 2018
[bootstrap.php] updating existed item whiping othed fileds values	2	321	September 6, 2022

Entries deleted inside Cockpit are retained in API

1) (Batch) deleting entries from collections

2) Deleting singletons

Related topics