Databricks Glossary
A ACL Access Control List (ACL). Auto Compaction Auto Compaction is part of the Auto Optimise feature in Databricks. It checks after an individual write, if files can further be compacted, if yes it runs an OPTIMISE job with 128MB file sizes instead of 1GB file size used in the standard OPTIMISE. Auto Compaction use 128MB for compacting files, while OPTIMISE command use 1GB. Auto Loader Auto Loader monitors a source location, in which files accumulate, to identify and ingest only new arriving files with each command run....