Dockerize the entire workflow

[Pro696969]

Add Dockerfile(s)

Minimal images:

• Python app image (base for producer, consumers, batch scripts)

• Optional separate Spark image to run Spark jobs via spark-submit (or use official Spark image with connector packages)

• Update/extend docker-compose.yaml to include:

  • zookeeper (already present)
  • kafka (already present — ensure advertised listeners work in compose)
  • postgres

• Provide .env.example and documented env variables for secrets/config

• Provide a Makefile or bash helper scripts for common tasks

can i try this :)

[Pro696969]

@chitniskedar7 okay cool but you will need it get a working dockerfile and the project should work entirely with docker files, do you still want to be assigned to this ? @chitniskedar7

[SiddarthAA]

hi can i be assigned to this @Pro696969 ??

[Pro696969]

@SiddarthAA are you able to run the project on your system ?

[SiddarthAA]

@SiddarthAA are you able to run the project on your system ?
yesyes so far so good

[SiddarthAA]

its not letting me to download the dataset tho

[Pro696969]

that must be kaggle issue... try to figure out why its not happening

[rohithbalasubramanya-dev]

can i get assigned to this issue??

[Pro696969]

@rohithbalasubramanya-dev can u run this proj on your system and send me ss only then i can assign this to you