cartwright

There are more general ways of doing something like this with LLMs. We are looking into LLMs to improve our results. Cartwright is very specific, but it is easy to add new categories to detect if you have specific categories in mind. See the contribution doc here. https://github.com/jataware/cartwright/blob/main/docs/contri...

Cartwright is a data profiler that identifies and categorizes spatial and temporal features. Cartwright uses deep learning, natural language processing, and a variety of heuristics to determine whether a column in a dataset contains spatial or temporal information and, if so, what is specifically contained. Cartwright was built to automate complex data pipelines for heterogenous climate and geopolitical data that are generally oriented around geospatial and temporal features (think maps and time series). The challenge that Cartwright solves is automatically detecting those features so they can be parsed and normalized. This problem turns out to be quite tricky, but Cartwright makes it simple.