~/Library/Metadata/SpotlightKnowledgeEvents using a lot of disk space

The title says it all. I'm running a 2018 MacMini on macOS Sequoia 15.2 with a 500GB drive, and this folder is consuming 150GB. The folder structure is then index.V2/journals/, followed by a 10 or 11, and then two folders: cs_default and cs_priority. The cs_default folders are filled with literally thousands of files starting with the title skg_events, and ending with extensions .toc or .journal. The modification dates start at Sept. 17, 2024, which I think is roughly when I first installed Sequoia.


I've tried a few things - stopping/starting Spotlight (but have not yet tried reindexing) and restarting in SafeMode.


EtreCheck report attached - yes, I have a lot of *stuff* on my system that affects

performance, but I'm really trying to figure out how to reclaim this disk space if possible. I appreciate your help!




Mac mini (2018)

Posted on Dec 26, 2024 6:57 PM

Reply
Question marked as ⚠️ Top-ranking reply

Posted on Jan 28, 2025 11:59 AM

I talked to Apple Support about this issue last night, basically to ask a single question (I'd had at least four previous support sessions with Apple on this one issue): is it safe to simply remove the files from the two folders (on Intel systems; on Apple Silicon systems the second folder is inside the first): ~/library/metadata/CoreSpotlight/, and ~/library/metadata/SpotlightKnowledgeEvents?


The advisor said that Apple okays this approach, with the caveat that you should delete these two folders' contents, not the folders themselves.


On the two Intel Macs I was having this issue with, I deleted these two folders' contents, and saw immediate performance gains. For one thing, both systems had roughly half a terabyte of Spotlight metadata in these two folders, so I reclaimed all that storage space. For another, I saw a huge improvement in any kind of search that involves Spotlight: Finder searches, Spotlight window searches (invoked by default [CMD]-[SPACEBAR]), any searches in Mail, including smart folders; and quite a bit less processor usage by corespotlightd, which I believe is the process that writes out all this data in the first place.


That said, the problem isn't eliminated entirely. On one of these two systems, the metadata folders accumulated 8.4 GB of new data in literally a hour and a half (although it seems to have stopped growing at that point), and on the other system about 23 GB accumulated from when I removed the data last night until late this morning. But if this trick worked once, there's no reason to suppose it won't work again. So, unless the 15.3 update (or maybe some later update) addresses this issue, I'll just keep an eye on the ~/library/metadata folder, and if it grows to say 100 GB or more I'll simply delete this data again. As far as I can tell, that seems to serve no purpose other than to significantly degrade Spotlight performance. It certainly doesn't speed up searches; in fact, at about 500 GB of data, search was essentially halted in its tracks.

54 replies
Sort By: 

Mar 26, 2025 1:54 AM in response to OliOS2

I have the exact same issue and went through an apple review. At that point my hard drive was down to under 5GB remaining which was causing major issues with my BIM software. We managed to remove over 100GB of data at around 5 thousand files. Since then the two folders continue to accumulate data.

Reply

Dec 27, 2024 6:03 AM in response to Stephen Epstein

FWIW, the path is actually: ~/Library/Metadata/CoreSpotlight/SpotlightKnowledgeEvents.

Mine is currently 80GBs so 150GBs is not particularly out of the realm of possibilities.


You could start in Safe Mode which will clear some caches, reboot normally and see if it is smaller.

Start up your Mac in safe mode - Apple Support

Reply

Dec 27, 2024 9:45 AM in response to Mac Jim ID

Maybe not the right move - I'm rebuilding the Spotlight index and excluded a few drives. The result is that the SpotlightKnowledgeEvents file is growing (another 3GB so far).


I've removed TTP. SoftRAID isn't likely to be the issue (though I can check with OWC). I'll be checking Disk Drill next.

Reply

Dec 27, 2024 11:16 AM in response to Stephen Epstein

Spotlight also indexes emails and if you have a huge number of emails that will increase the index size. Does it seem like you would have an extreme amount of emails, maybe over several email addresses totaling more than a thousand?


I do agree that the files size you noted seems like a lot compared to what I see on my device and reported by dialabrain.

Reply

Jan 23, 2025 11:42 AM in response to Stephen Epstein

Hi,

My folder "~/Library/Metadata/SpotlightKnowledgeEvents/index.V2/journals/11/cs_default" has 4104 files, and is consuming 100GB.


The first file is from December 11th at 10:10 p.m., and at that time the operating system was updated to version 15.2.

I am convinced that this is a problem with the Sequoia 15.2 version (24C101)


Any ideas what I can do?


Thx a lot!

Reply

Jan 24, 2025 7:48 AM in response to XRoom

XRoom wrote:

Hi,
My folder "~/Library/Metadata/SpotlightKnowledgeEvents/index.V2/journals/11/cs_default" has 4104 files, and is consuming 100GB.
The first file is from December 11th at 10:10 p.m., and at that time the operating system was updated to version 15.2.
I am convinced that this is a problem with the Sequoia 15.2 version (24C101)

Just for comparison, in my cs_default folder I have 1300 files that consume 516MB and my first file was created September 16, which for me is specific to Mac OS 15.0. I have no files in there that were created after the 15.2 update, so for me there is no connection at all to the Sequoia 15.2 version.


Have you tried rebuilding your Spotlight Index?

I very rarely clear my Safari cookies, so I agree that is not the reason why yours would be consuming 100GB.

Reply

Jan 24, 2025 10:12 AM in response to Stephen Epstein

You may be on to something with the DEVONThink 3 archiving your email. I have reviewed many of the files in the cs_default folder by opening them in TextEdit and it just reveals snippets of emails and messages, but the file sizes are small.


Since you were seeing 100GB on 4100 files, it would seem some of those files were very large. If you get a chance, try opening some of those large files you see in that folder to see if it gives you some clue on what is being indexed. Not all of the info is readable due to the Text Encoding, but you will be able to make out some of what you see there.


Reply

Jan 24, 2025 10:28 AM in response to Mac Jim ID

Mac Jim ID wrote:

You may be on to something with the DEVONThink 3 archiving your email. I have reviewed many of the files in the cs_default folder by opening them in TextEdit and it just reveals snippets of emails and messages, but the file sizes are small.

Since you were seeing 100GB on 4100 files, it would seem some of those files were very large. If you get a chance, try opening some of those large files you see in that folder to see if it gives you some clue on what is being indexed. Not all of the info is readable due to the Text Encoding, but you will be able to make out some of what you see there.

Just looking at the largest of the several hundred files (10-200 MB) written out so far just today in TextEdit as you suggested, I can see that essentially all of them are related to a large Pages file I'm editing (well, relatively large; it's less than 12 MB, although some other Pages files I've edited in the past have exceeded 200 MB). This comports with other posts I've read from people also having trouble with Spotlight: processor usage by corespotlightd seems to spike when editing large Pages documents (probably all iWork docs, but Pages files probably tend to be larger than say Numbers spreadsheets), especially when those files are synced via iCloud.


I noted that power consumption on my 21-inch iMac started increasing around 7:30 this morning before I'd even gotten to work (that system is my work computer). But 7:30 is about the time I started editing a Pages document on my iMac Pro at home.

Reply

Jan 24, 2025 10:34 AM in response to Stephen Epstein

I have disabled Spotlight indexing of the entire hard drive, disabled all indexing options, and restarted the computer. Files are still being generated but at the moment they are small (a few KB each file).

I have reviewed some large files (some are over 1.3GB), and indeed it seems to contain email indexing information.


I have a couple of mailboxes that are quite large, but the information in this folder only looks like a "journal" information of indexing process (as it includes in the file names), and it is not properly deleted.


I'll restart Spotlight indexing again, and we'll see what happens, but I think I'll eventually delete the files manually

Reply

Jan 24, 2025 10:42 AM in response to XRoom

XRoom wrote:

I have disabled Spotlight indexing of the entire hard drive, disabled all indexing options, and restarted the computer. Files are still being generated but at the moment they are small (a few KB each file).
I have reviewed some large files (some are over 1.3GB), and indeed it seems to contain email indexing information.

I have a couple of mailboxes that are quite large, but the information in this folder only looks like a "journal" information of indexing process (as it includes in the file names), and it is not properly deleted.

I'll restart Spotlight indexing again, and we'll see what happens, but I think I'll eventually delete the files manually

I tried reindexing on all four of my Macs (twice on my iMac Pro), and oddly enough none of the existing Spotlight metadata seems to have been deleted during or after the reindex. I still see Spotlight metadata files going all the way back to when I installed Sequoia on each of these systems.

Reply

Jan 24, 2025 10:44 AM in response to XRoom

I rectify, really after the restart it has created large files, some are more than 1GB.

I had only looked at the .toc type files when the big files are really the .journal type ones.


The content of some files I've reviewed points to email indexing, even though indexing for everything is disabled.


It clearly seems like a BUG in this version of Sequoia, although it does not occur on all systems (there may be some other factor causing it)

Reply

Jan 24, 2025 10:48 AM in response to ericmurphysf

ericmurphysf wrote:


XRoom wrote:

I have disabled Spotlight indexing of the entire hard drive, disabled all indexing options, and restarted the computer. Files are still being generated but at the moment they are small (a few KB each file).
I have reviewed some large files (some are over 1.3GB), and indeed it seems to contain email indexing information.

I have a couple of mailboxes that are quite large, but the information in this folder only looks like a "journal" information of indexing process (as it includes in the file names), and it is not properly deleted.

I'll restart Spotlight indexing again, and we'll see what happens, but I think I'll eventually delete the files manually
I tried reindexing on all four of my Macs (twice on my iMac Pro), and oddly enough none of the existing Spotlight metadata seems to have been deleted during or after the reindex. I still see Spotlight metadata files going all the way back to when I installed Sequoia on each of these systems.

I’m not sure what the folder in the topic of this discussion holds, but re-indexing Spotlight only alters the data stored in the hidden .Spotlight–V100 folder at the root of the drive.

essentially, all metadata attached to a file is Spotlight metadata, but it is not removed when you re-index spotlight.

Reply

Jan 24, 2025 4:01 PM in response to Stephen Epstein

Stephen Epstein wrote:

I only have an Intel MacMini (2018). Can anyone confirm that this problem is limited to Intel Macs? Maybe we're on to something with a Sequoia bug that only affects Intel Macs, and not Apple Silicon.

I believe it affects Apple Silicon Macs as well, but to a much lesser extent. My M2 Max MacBook Pro's SpotlightKnowledgeEvents folder has about 42 GB of data in it, and my Mac Studio M1 Ultra has about 8 GB in the same folder. I'm not sure why the MBP has so much more metadata; it actually has a smaller user folder than the Mac Studio.


But both are significantly smaller than the 500+ GB on my two Intel Macs.

Reply

~/Library/Metadata/SpotlightKnowledgeEvents using a lot of disk space

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.