Skip to content

feat: add AutoMQ integration quickstart demo #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

lyx2000
Copy link

@lyx2000 lyx2000 commented Aug 13, 2025

Summary

Added a complete quickstart demo showcasing Lightstreamer Kafka Connector integration with AutoMQ, a cloud-native Kafka distribution with S3-based storage.

What's Added

  • Complete AutoMQ Demo Setup: New quickstart example in examples/vendors/automq/quickstart-automq/
  • AutoMQ Broker Configuration: Single-node AutoMQ cluster with KRaft mode and S3 storage backend
  • S3 Storage Integration: MinIO as S3-compatible storage for AutoMQ data and operational metadata
  • Monitoring Dashboard: Kafka UI for cluster monitoring and management
  • Production-Ready Configuration: Proper network setup, health checks, and service dependencies

Key Features

  • Cloud-Native Architecture: Demonstrates AutoMQ's compute-storage separation
  • S3-Based Storage: Cost-effective storage with automatic bucket management
  • Real-Time Streaming: Live stock data streaming from Kafka to web clients via Lightstreamer
  • Easy Deployment: Single-command Docker Compose setup
  • Built-in Monitoring: Integrated Kafka UI accessible at http://localhost:12000

Services Included

  • AutoMQ Kafka cluster (automqinc/automq:latest)
  • MinIO S3-compatible storage
  • Lightstreamer Kafka Connector
  • Sample data producer
  • Kafka UI for monitoring

Testing

  • Verified complete stack deployment
  • Tested real-time data streaming functionality
  • Confirmed S3 storage integration
  • Validated monitoring dashboard access

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant