Documentation Index
Fetch the complete documentation index at: https://docs.allgoodhq.com/llms.txt
Use this file to discover all available pages before exploring further.
What is a Dataset?
A dataset is a reference copy of your marketing automation platform data (such as Marketo or Salesforce) that syncs into allGood’s environment on a specified interval. Your marketing automation system remains the source of truth — allGood maintains a synchronized copy for efficient lookup and processing purposes. Users can view and refresh datasets, but cannot create or modify them directly. Datasets are managed by the allGood team and kept in sync with your source systems.Why Datasets Exist
API Limitations
Marketing automation platforms, particularly Marketo, have API limitations that make real-time lookups unreliable for the kind of operations allGood performs at scale:- Rate limits and concurrency caps: Restrictions on how quickly data can be retrieved on demand
- Response consistency issues: Marketo may return incomplete or inaccurate information about what actually exists through the API
- Query latency: Direct API queries introduce delays that compound when processing large volumes of data
Performance Benefits
Querying allGood’s cached database copy is faster and more reliable than making repeated API calls for every lookup operation. This approach ensures:- Consistent response times regardless of your platform’s current API load
- Accurate data validation without taxing your API limits
- Scalable processing that doesn’t impact your other integrations and workflows
Salesforce’s API does not exhibit the same consistency issues, so dataset functionality is primarily a solution for Marketo-specific challenges.
Sync Cadence
Dataset synchronization is fully configurable based on your needs:- Standard cadence: Overnight syncs for most use cases
- High-frequency cadence: Hourly syncs when near-real-time data is required
What Datasets Enable
Datasets are a foundational component that power multiple allGood capabilities by providing fast, reliable access to your existing database:Data Enrichment Optimization
Before sending contact data to external enrichment providers, allGood checks the dataset to determine if the data already exists in your database:- Smart enrichment: Only enrich fields that are truly missing, not ones that already exist in your system
- Cost optimization: Avoid unnecessary enrichment calls for data you already have
- Faster processing: Skip enrichment entirely for records that are already complete
Lead Screening and Validation
Validate incoming leads against your existing database before processing:- Existing contact detection: Identify whether a lead is already in your system
- Data completeness checking: Determine what information you already have for a contact
- Account relationship validation: Verify connections to existing account records
Lead Routing and Assignment
Route leads based on existing database relationships:- Account-based routing: Assign leads to the same owner as their associated account
- Territory-based assignment: Route based on existing territory rules in your database
- Relationship-aware routing: Consider existing contact relationships when assigning new leads
Lead-to-Account Matching
Connect incoming leads to existing account records using your database as reference:- Company matching: Link leads to accounts based on company name, domain, and other identifiers
- Hierarchy awareness: Understand parent-subsidiary relationships from your existing data
Reporting and Analytics
Provide insights into your data quality and coverage:- Data completeness analysis: Identify gaps in your existing database
- Quality trends: Monitor data quality metrics over time
Getting Started
Datasets are configured and managed by the allGood team as part of your integration setup. If you’re interested in enabling dataset functionality for your organization:- Review your integration: Ensure your Marketo or Salesforce connection is fully configured
- Discuss sync cadence: Determine whether overnight or hourly syncing best fits your needs
- Contact allGood: Reach out to your allGood representative to enable dataset functionality