Skip to main content
Version: Next

Slack

Testing

Important Capabilities

CapabilityStatusNotes
Detect Deleted EntitiesOptionally enabled via stateful_ingestion.remove_stale_metadata

CLI based Ingestion

Config Details

Note that a . is used to denote nested fields in the YAML recipe.

FieldDescription
bot_token 
string(password)
Bot token for the Slack workspace. Needs users:read, users:read.email, users.profile:read, and team:read scopes.
api_requests_per_min
integer
Number of API requests per minute. Low-level config. Do not tweak unless you are facing any issues.
Default: 10
channel_min_members
integer
Ingest channels with at least this many members.
Default: 2
channels_iteration_limit
integer
Limit the number of channels to be ingested in a iteration. Low-level config. Do not tweak unless you are facing any issues.
Default: 200
enrich_user_metadata
boolean
When enabled, will enrich provisioned DataHub users' metadata with information from Slack.
Default: True
ingest_public_channels
boolean
Whether to ingest public channels. If set to true needs channels:read scope.
Default: False
ingest_users
boolean
Whether to ingest users. When set to true, will ingest all users in the Slack workspace (as platform resources) to simplify user enrichment after they are provisioned on DataHub.
Default: True
should_ingest_archived_channels
boolean
Whether to ingest archived channels.
Default: False
stateful_ingestion
StatefulIngestionConfig
Stateful Ingestion Config
stateful_ingestion.enabled
boolean
Whether or not to enable stateful ingest. Default: True if a pipeline_name is set and either a datahub-rest sink or datahub_api is specified, otherwise False
Default: False

Code Coordinates

  • Class Name: datahub.ingestion.source.slack.slack.SlackSource
  • Browse on GitHub

Questions

If you've got any questions on configuring ingestion for Slack, feel free to ping us on our Slack.