kafka-proxy via Layer 7

[Patrick Flach]

Hello all,

I try to run a kafka consumer via kafka-proxy, which forwards all requests to a Layer 7.

   kafka-proxy server --bootstrap-server-mapping "my-kafkabroker:9092,127.0.0.1:9092" \
                       --forward-proxy http://my-layer7:8080

Packet captures show the http request going out the kafka-proxy, see attached picture. Problem is, I cannot find any setting and policy accepting the traffic (http/CONNECT) trough Layer 7.

I always get a HTTP/1.1 400 Bad Request.

Has anyone an idea how to configure Layer 7 that it allows this communication?

Replacing the L7 by tinyproxy  is solving the problem, but I need to security checks which only L7 can do.

Thanks!

[ADNAN Siddiqui]

To configure Layer7 API Gateway to work with Kafka-proxy, you'll need to create a custom policy that accepts and processes the incoming Kafka-proxy requests.

[Tom Porterfield]

Not sure if it helps, but adding kafka consumer support was listed as a candidate for PI33 according to blog post at https://community.broadcom.com/enterprisesoftware/blogs/gregory-thompson1/2023/01/23/layer7-work-in-progress-update-pi32.

[Ben Urbanski]

Thank you, Tom. I can confirm that we will be working on the Kafka consumer support in PI33 which starts today. It's planned to be include in the 11.0 CR1 release which is tentatively planned for 8/9 (all subject to change). We are looking for customers who would be interested in previewing this capability as we complete it and before it's released. If anyone in this thread is interested, please reply directly to me. Thanks!