Skip to content

Upload files

Files can be uploaded to Spotlight using the 'Add new' button button on the home page, the 'Add' button button from inside a Workspace, or by simply dragging and dropping files directly into the browser window on most pages.

Privacy#

Any files you upload will live in your company's Spotlight environment and all the other Spotlight users in your organization will be able to read and use them in their own work. Please consider the confidentiality of files before uploading them to Spotlight.

File types#

Any type of file can be uploaded to Spotlight. Depending on what type of file is uploaded, Spotlight will turn it into either a dataset or a document.

Files in CSV, XLS/XLSX/XLSB, JSON, and Parquet formats become datasets in Spotlight and can be viewed and interacted with inside a Workspace's Workbench. All other formats (including PDF, DOC, and image files) are handled as documents.

General considerations#

  • Name - Cannot contain the backtick (`) character or begin with either a space or an underline (_) character.
  • File size - Files up to 1Gb are supported by default. Larger CSV, JSON, or Parquet files can be stored on S3 and connected to Spotlight from there.
  • Data size - Dataset files with more than 512 columns will not upload to Spotlight. Datasets containing more than 3 million rows will upload but are not processed by Spotlight and will display with an error (warning triangle - yellow) next to their names (see Supported data: Data size for details).

JSON files#

Well-formed JSON files are parsed automatically so that keys become column names while values, including nested JSON values, become records. A log-style JSON file where every line is a JSON object will be parsed into multiple records.

Excel files#

Excel supports TimeType columns that contain no date or time zone information (eg "10:00 am"). If you upload excel files with TimeType data in them, those columns will be converted into strings inside Spotlight.