Auto Shrink dont get triggered

[h3ku]

Hi,

I have a program that performs some crawling, store and update data in buntdb and stops, after a few minutes a crontab launch de program again.

I don't know why but the database size grows and grows, containing some keys duplicated more than 50 times (Ending in multiple GB values completely full of duplicates).

There's any way I can force BuntDB to shrink the file at the end of every execution of the program or something like this?

[h3ku]

I just make it work with a db.Shrink() at the end, it works fine but I don't have clues of why the AutoShrink don't work.

[tidwall]

Hi,

I'm sorry to hear that your running into issues. I would like to reproduce this issue on my side.

Do you update your config using the db.WriteConfig function? If so, could you provide your configuration code?

[tidwall]

Are you still running into this issue? I wasn't able to reproduce it.

[tidwall]

I’m closing this for now but feel free to reopen if you are still running into problems. Thanks!

[cute-angelia]

func TestAutoShrink2(t *testing.T) {
	dbpath := "/tmp/test_2.db"
	if db, err := buntdb.Open(dbpath); err == nil {
		db.SetConfig(buntdb.Config{
			AutoShrinkDisabled:   true, // not work
			AutoShrinkMinSize:    1,    // not work
			AutoShrinkPercentage: 30,
		})
		for i := 0; i < 20; i++ {
			writeCache2(db)
			time.Sleep(time.Second * 5)
		}
	}
}

func writeCache2(db *buntdb.DB) {
	for i := 0; i < 10000; i++ {
		log.Println("--> ", i)
		val := "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ"
		db.Update(func(tx *buntdb.Tx) error {
			tx.Set(fmt.Sprintf("%s%d", "test", i), val, &buntdb.SetOptions{Expires: true, TTL: time.Hour})
			return nil
		})
	}
}

the db file size is sustained growth ... without Shrink

I would it like file-rotatelogs

[cute-angelia]

@tidwall

[tidwall]

@cute-angelia

Are you wanting to disable AutoShrink?

Your code is disabling the AutoShrink. This will make the database continue grow until db.Shrink() is called.