Integrations

BSPump provides integrations with many external systems. This section covers the available connectors, sources, sinks, and configuration options.

• Kafka Integration
  • Installation
  • Components
  • KafkaConnection
  • KafkaSource
  • KafkaSink
  • Dynamic Topic Routing
  • Message Keys
  • Complete Example
  • Configuration Reference
• HTTP Integration
  • Components
  • WebHookSource
  • Multiple Endpoints
  • HTTPClientSink
  • Webhook Validation
  • Complete Webhook Example
  • HTTP Client for Data Fetching
  • Configuration Reference
• PostgreSQL Integration
  • Installation
  • Components
  • PostgreSQLConnection
  • PostgreSQLSource
  • PostgreSQLSink
  • PostgreSQLLookup
  • Complete Example
  • Raw Query Execution
  • Configuration Reference
• MongoDB Integration
  • Installation
  • Components
  • MongoDBConnection
  • MongoDBSource
  • MongoDBSink
  • MongoDBLookup
  • Complete Example
  • Upsert Operations
  • Aggregation Pipeline
  • Configuration Reference
• Elasticsearch Integration
  • Installation
  • Components
  • ElasticSearchConnection
  • ElasticSearchSink
  • ElasticSearchSource
  • Complete Example
  • Time-Based Indices
  • Dynamic Index Routing
  • Bulk Operations
  • Configuration Reference
• MQTT Integration
  • Installation
  • Components
  • MQTTConnection
  • MQTTSource
  • MQTTSink
  • Complete Example
  • Topic Wildcards
  • Dynamic Topic Routing
  • QoS Levels
  • Retained Messages
  • MQTT Pipeline Inspection
  • Configuration Reference
• File Integration
  • Components
  • FileLineSource
  • FileCSVSource
  • FileJSONSource
  • FileLineSink
  • FileCSVSink
  • Complete Example
  • Glob Patterns
  • File Watching
  • Processing Large Files
  • Temporary Files
  • Configuration Reference

Overview

Integration	Connection	Source	Sink
Kafka Integration	Yes	Yes	Yes
HTTP Integration	No	Yes (Webhook)	Yes (Client)
PostgreSQL Integration	Yes	Yes	Yes
MongoDB Integration	Yes	Yes	Yes
Elasticsearch Integration	Yes	Yes	Yes
MQTT Integration	Yes	Yes	Yes
File Integration	No	Yes	Yes

Additional Integrations

BSPump also supports:

• AMQP/RabbitMQ: bspump.amqp

• InfluxDB: bspump.influxdb

• MySQL: bspump.mysql

• ODBC: bspump.odbc

• FTP/SFTP: bspump.ftp, bspump.ssh

• Slack: bspump.slack

• Google Drive: bspump.googledrive

• LDAP: bspump.ldap

• ZooKeeper: bspump.zookeeper

See the API Reference for complete documentation of all modules.