Skip to content

Source code and data for the paper "SALT: Sales Autocompletion Linked Business Tables Dataset"

License

Notifications You must be signed in to change notification settings

SAP-samples/salt

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SALT: Sales Autocompletion Linked Business Tables Dataset

made-with-python License REUSE status

News

  • 12/22/2024: 🎊 Data available via Hugging Face only 🎉
  • 12/19/2024: Train/test split provided
  • 12/15/2024: Preliminatry dataset available on Hugging Face.
  • 12/13/2024: Provided data
  • 10/29/2024: Preliminary repository created

Description

This repository contains the dataset from our paper SALT: Sales Autocompletion Linked Business Tables Dataset presented at NeurIPS'24 Table Representation Workshop.

Abstract

Foundation models, particularly those that incorporate Transformer architectures, have demonstrated exceptional performance in domains such as natural language processing and image processing. Adapting these models to structured data, like tables, however, introduces significant challenges. These difficulties are even more pronounced when addressing multi-table data linked via foreign key, which is prevalent in the enterprise realm and crucial for empowering business use cases. Despite its substantial impact, research focusing on such linked business tables within enterprise settings remains a significantly important yet underexplored domain. To address this, we introduce a curated dataset sourced from an Enterprise Resource Planning (ERP) system, featuring extensive linked tables. This dataset is specifically designed to support research endeavors in table representation learning. By providing access to authentic enterprise data, our goal is to potentially enhance the effectiveness and applicability of models for real-world business contexts.

Dataset on Hugging Face

The dataset is now also available via the Hugging Face dataset platform. Check-out: SALT

from datasets import load_dataset

ds = load_dataset("sap-ai-research/SALT")

Usage

Example of loading the tables with Hugging Face datasets

Unless pandas library is already installed, install it with:

pip install pandas
from datasets import load_dataset

dataset_name = "sap-ai-research/SALT"
split = "train"  # use "train" or "test"
salesdocuments = load_dataset(dataset_name, "salesdocuments", split=split)
salesdocument_items = load_dataset(dataset_name, "salesdocument_items", split=split)
customers = load_dataset(dataset_name, "customers", split=split)
addresses = load_dataset(dataset_name, "addresses", split=split)

# you can also load the joined table which combines the four tables in one
joined_table = load_dataset(dataset_name, "joined_table", split=split)

Information

Table Schema of SALT Dataset Table Schema of SALT Dataset

Screenshot of a Salesorder Input Mask Example Input Mask of a Salesorder App using SAP S/4HANA

Requirements

N/A

Known Issues

No known issues

Authors:

Citations

If you use this dataset in your research or want to refer to our work, please cite:

@inproceedings{
klein2024salt,
title={{SALT}: Sales Autocompletion Linked Business Tables Dataset},
author={Tassilo Klein and Clemens Biehl and Margarida Costa and Andre Sres and Jonas Kolk and Johannes Hoffart},
booktitle={NeurIPS 2024 Third Table Representation Learning Workshop},
year={2024},
url={https://openreview.net/forum?id=UZbELpkWIr}
}

Roadmap

  • Integration into RelBench, Feb'25
  • Release dataset

How to obtain support

Create an issue in this repository if you find a bug or have questions about the content.

For additional support, ask a question in SAP Community.

Contributing

If you wish to contribute code, offer fixes or improvements, please send a pull request. Due to legal reasons, contributors will be asked to accept a DCO when they create the first pull request to this project. This happens in an automated fashion during the submission process. SAP uses the standard DCO text of the Linux Foundation.

License

Copyright (c) 2024 SAP SE or an SAP affiliate company. All rights reserved. This project is licensed under the CC-BY-NC-SA Software License, version 4.0 except as noted otherwise in the LICENSE file.

About

Source code and data for the paper "SALT: Sales Autocompletion Linked Business Tables Dataset"

Topics

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published