Reference Guide

• 1. Presentation
  • 1.1. Who is Tale of Data for?
  • 1.2. How it works
  • 1.3. Getting Started Guide
• 2. The Catalog view
  • 2.1. Catalog view
    • 2.1.1. Accessing datasets
    • 2.1.2. Create or Edit a CSV file
    • 2.1.3. Accessing repositories
  • 2.2. Upload files into Tale of Data
    • 2.2.1. Uploading a file
    • 2.2.2. Alter the destination repository for upload
    • 2.2.3. Creating, renaming and deleting repositories and files
  • 2.3. Creating flows from the catalog
    • 2.3.1. Add one or more datasets to an (existing or new) flow
    • 2.3.2. Configuring the import of selected datasets to a (new or existing) flow
  • 2.4. Other catalog view functions
    • 2.4.1. Deletion of relational database tables
    • 2.4.2. Display the number of rows in a dataset
    • 2.4.3. Display dataset statistics
    • 2.4.4. Downloading a dataset from the catalog
  • 2.5. Flow, dataset and record lineage
    • 2.5.1. Access to the data lineage from the catalog
    • 2.5.2. Upstream lineage
    • 2.5.3. Downstream lineage
    • 2.5.4. Access to the data lineage from the flow editor
    • 2.5.5. Access to the data lineage from the dashboards
• 3. The Flow Designer
  • 3.1. Create a flow in the flow view
  • 3.2. Scheduling of flows and sequences view
  • 3.3. Rename the selected group
  • 3.4. Flow Designer
  • 3.5. Flow Designer interface
    • 3.5.1. Show and hide the documentation on the canvas
    • 3.5.2. Add or modify descriptions on nodes or on the flow.
    • 3.5.3. Flow history
    • 3.5.4. Delete
    • 3.5.5. Refresh
    • 3.5.6. Generating flow documentation
    • 3.5.7. Importing flow nodes and functions
• 4. Data processing: flow tools
• 5. Activating Generative AI within Tale of Data
  • 5.1. Possibilities offered by enabling LLMs
    • 5.1.1. Line-by-line AI: leveraging AI at an industrial scale
    • 5.1.2. Natural language transformations: frugal AI, predictable processing without token consumption
    • 5.1.3. AI-enriched flash audit
    • 5.1.4. Documentation automatique des flows
  • 5.2. Data security and control
    • 5.2.1. Local or remote LLM
    • 5.2.2. Control over the scope of shared data
  • 5.3. Connecting to generative AI providers
    • 5.3.1. Set up your API key
  • 5.4. Line-by-line AI: The “Generative AI” node for Flows
    • 5.4.1. General overview
    • 5.4.2. Line-by-line AI use cases
    • 5.4.3. Add and configure the node in a flow
    • 5.4.4. “Configuration” tab
    • 5.4.5. “Cost” tab
    • 5.4.6. “Advanced options” tab
    • 5.4.7. Typical sequence of use
  • 5.5. Natural language data transformation
    • 5.5.1. Instruction examples
    • 5.5.2. Best practices
    • 5.5.3. Configuration
    • 5.5.4. Results analysis
    • 5.5.5. Editing the transformation
  • 5.6. Get a Data Quality Flash Audit
• 6. The Preparation Node
  • 6.1. Description
  • 6.2. Interface
    • 6.2.1. Open the editor
    • 6.2.2. Browse editor views
    • 6.2.3. Data transformation view
    • 6.2.4. Transformation History
    • 6.2.5. View a transformation stage
    • 6.2.6. Invalid transformations
    • 6.2.7. Editing a transformation
  • 6.3. Data quality
    • 6.3.1. Managing natures
    • 6.3.2. Available natures
    • 6.3.3. Add Field Validation Rule
    • 6.3.4. Update Field Validation Rule
    • 6.3.5. Remove (Field) Validation Rule
    • 6.3.6. Add a Record validation rules
  • 6.4. Visualization
  • 6.5. Transformation configuration and use
  • 6.6. Quick access to transformations
  • 6.7. Viewing the changes made by a transformation
  • 6.8. Field transformations
    • 6.8.1. Add a Column
    • 6.8.2. Concat columns
    • 6.8.3. Copy a Column
    • 6.8.4. Split Column
    • 6.8.5. Merge columns
    • 6.8.6. Change Column type
    • 6.8.7. Fill the missing values
    • 6.8.8. Rename column
    • 6.8.9. Rename several columns
    • 6.8.10. Reorder Columns
    • 6.8.11. Remove Column
    • 6.8.12. Transpose columns to rows
    • 6.8.13. Mask sensitive data
  • 6.9. Record transformations
    • 6.9.1. Create Integer Sequence
    • 6.9.2. Delete Filtered Rows
    • 6.9.3. Delete Empty Rows
  • 6.10. Text transformations
    • 6.10.1. Add a prefix
    • 6.10.2. Add a suffix
    • 6.10.3. Attribute a value to cells
    • 6.10.4. Capitalize
    • 6.10.5. Right Pad
    • 6.10.6. Left Pad
    • 6.10.7. Convert to lowercase
    • 6.10.8. Convert to uppercase
    • 6.10.9. Unescape HTML entities
    • 6.10.10. Escape HTML entities
    • 6.10.11. Unescape Unicode
    • 6.10.12. Normalize spaces
    • 6.10.13. Find / Replace
    • 6.10.14. Infer Language
    • 6.10.15. Remove HTML code
    • 6.10.16. Remove diacritics
    • 6.10.17. Remove spaces from both ends
    • 6.10.18. Remove unwanted characters
  • 6.11. Numeric transformations
    • 6.11.1. Round a Decimal
    • 6.11.2. Create intervals of fixed-size
    • 6.11.3. Convert measurement units
    • 6.11.4. Extract Numbers
  • 6.12. Date transformations
    • 6.12.1. Add Current Date Time
    • 6.12.2. Convert an integer to date
    • 6.12.3. Extract Date Part
    • 6.12.4. Format a date using a custom format
    • 6.12.5. Format a date using a predefined pattern
    • 6.12.6. Dates interval
    • 6.12.7. Date recognition
  • 6.13. Clustering transformations
    • 6.13.1. Phonetic clustering
    • 6.13.2. Consonant-first fingerprint
    • 6.13.3. Exact match fingerprint
    • 6.13.4. Universal fingerprint
    • 6.13.5. Vowels-first fingerprint
    • 6.13.6. N-Gram clustering
  • 6.14. Deduplication transformations: multi-algorithm deduplication
  • 6.15. Nature transformations
    • 6.15.1. Define Column Nature
    • 6.15.2. Remove Column Nature
    • 6.15.3. Split URL
    • 6.15.4. Decode URLs
    • 6.15.5. Encode URLs
    • 6.15.6. Shape First Names
    • 6.15.7. Extract Full Names parts
    • 6.15.8. Shape Proper Nouns
    • 6.15.9. Shape Genders
    • 6.15.10. Shape Civilities
    • 6.15.11. Shape Nationalities
    • 6.15.12. Extract SIREN code
  • 6.16. Geographic transformations
    • 6.16.1. Parse Address
    • 6.16.2. Convert country codes
    • 6.16.3. Fix deprecated INSEE Commune Codes (France)
    • 6.16.4. Deduce geographic data from ZipCodes (France)
    • 6.16.5. Enrich from INSEE Commune Codes (France)
    • 6.16.6. Enrich from ZipCodes (France)
    • 6.16.7. Enrich with Country Codes
    • 6.16.8. Geocode Address
    • 6.16.9. Find the country from latitude and longitude
    • 6.16.10. Standardize French postal addresses (AFNOR NF Z 10-011)
    • 6.16.11. Standardize French postal addresses (S42)
  • 6.17. Phone number transformations
    • 6.17.1. Extract Country from International Phone Number
    • 6.17.2. Shape Phone Numbers
    • 6.17.3. Correct Phone Numbers to International
  • 6.18. Email address transformations
    • 6.18.1. Split Email address
    • 6.18.2. Shape Emails
    • 6.18.3. Check E-mail consistency
  • 6.19. Advanced transformations
    • 6.19.1. Split an Array
    • 6.19.2. Business Rule Set Dataset
    • 6.19.3. Generate Unique Identifiers
    • 6.19.4. Negate Boolean Value
    • 6.19.5. Reconcile / Enrich with Repository data
    • 6.19.6. Script Based
    • 6.19.7. Smart Select
    • 6.19.8. Add a Quality Indicator
  • 6.20. Tale of Data standard natures specification
    • 6.20.1. Banking Natures
    • 6.20.2. Telecommunications
    • 6.20.3. Geographical Natures
    • 6.20.4. GTIN and ISBN Codes
    • 6.20.5. Personal data
    • 6.20.6. Specifically French natures
• 7. Scheduling and launching flows, creating notifications
  • 7.1. Planning and running flows
  • 7.2. Including a notification in a flow
  • 7.3. Scheduling and running flow sequences
  • 7.4. Batch mode runs
    • 7.4.1. Configuration of batch mode
    • 7.4.2. Running a flow in batch mode
    • 7.4.3. Tracking a batch run
    • 7.4.4. Important: Good practice when running a flow in batch mode
  • 7.5. Launching flows and flow sequences using API
    • 7.5.1. Getting an API key
    • 7.5.2. Flow launching API
    • 7.5.3. API launching flow sequences
• 8. Viewing data: dashboards
  • 8.1. Introduction
    • 8.1.1. Data Visualization
    • 8.1.2. Visual data exploration
    • 8.1.3. Dashboard Reader Licence
  • 8.2. Creating and adjusting dashboards
    • 8.2.1. Dashboards and data sources
    • 8.2.2. Adding pages and charts
    • 8.2.3. Configuring a histogram
    • 8.2.4. Important configuration options common to all types of chart
    • 8.2.5. Dashboard refresh settings
  • 8.3. Overview of chart types
    • 8.3.1. Bars
    • 8.3.2. Histogram
    • 8.3.3. Comparison with the mean
    • 8.3.4. Clustered bars
    • 8.3.5. Grouped histogram
    • 8.3.6. Scatter graph
    • 8.3.7. Donut
    • 8.3.8. Sector
    • 8.3.9. Table
    • 8.3.10. Pivot table
    • 8.3.11. Time series
    • 8.3.12. Indicator
    • 8.3.13. Radar
    • 8.3.14. Waterfall
    • 8.3.15. Map
    • 8.3.16. Points map
  • 8.4. Using dashboards
    • 8.4.1. Display the list of dashboards
    • 8.4.2. Sharing a dashboard
    • 8.4.3. Interactive dashboard browsing
• 9. Window function
  • 9.1. Description
  • 9.2. Window Specification tab
    • 9.2.1. Setting frame boundaries through partitioning
    • 9.2.2. Add frame boundaries
  • 9.3. Calculated fields tab
    • 9.3.1. Calculation of the position of each row in the window
    • 9.3.2. Aggregation functions
• 10. Tale of Data repositories
  • 10.1. What are indexed repositories?
  • 10.2. Use cases – how and why repositories are used
  • 10.3. Creating a repository
    • 10.3.1. Configuring an indexed repository
    • 10.3.2. Search fields
    • 10.3.3. Search groups
    • 10.3.4. Lists of replacements
  • 10.4. Using repositories
• 11. Data Discovery and Data Observability (MDD module)
  • 11.1. View of analyses
  • 11.2. Configuration of an analysis
    • 11.2.1. General settings
    • 11.2.2. Data sources
    • 11.2.3. Natures
    • 11.2.4. Advanced statistics
    • 11.2.5. Export of results
    • 11.2.6. Flow or sequence of flows to trigger at the end of the analysis
    • 11.2.7. Scheduling
  • 11.3. View of executions
    • 11.3.1. Stopping and resuming executions
  • 11.4. Custom Nature Configuration
    • 11.4.1. Nature type
  • 11.5. Exploitation of the results of an analysis
    • 11.5.1. Different ways to make use of the results
    • 11.5.2. Global Statistics
    • 11.5.3. Advanced Statistics
    • 11.5.4. Semantic analysis of data
    • 11.5.5. Exploitation of the raw data from analyses
• 12. Collaboration in Tale of Data
  • 12.1. Collaborative Workspaces
    • 12.1.1. How collaborative workspaces work
    • 12.1.2. Manage spaces
  • 12.2. Data source copies
  • 12.3. Copying flows
  • 12.4. Copying dashboards
  • 12.5. Sharing flows for collaborative review
    • 12.5.1. How it works
    • 12.5.2. Lifecycle of a flow share
    • 12.5.3. Notes
    • 12.5.4. Status
    • 12.5.5. Email notifications