Skip to content

Kafka fails to connect with OAUTHBEARER configuration #13223

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
plockaby-ionq opened this issue Apr 15, 2025 · 0 comments
Open

Kafka fails to connect with OAUTHBEARER configuration #13223

plockaby-ionq opened this issue Apr 15, 2025 · 0 comments
Labels
bug Bug report

Comments

@plockaby-ionq
Copy link

Describe the bug
Trying to connect to a Kafka instance that uses OAUTHBEARER tokens fails.

To Reproduce
Steps to reproduce the behavior:

  1. Configure a Google Managed Kafka cluster.
  2. Configure kafka like this in the helm chart:
      springKafkaConfigurationOverrides:
        security.protocol: SASL_SSL
        sasl.mechanism: "OAUTHBEARER"
        sasl.login.callback.handler.class: org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler
        sasl.oauthbearer.token.endpoint.url: http://localhost:14293
        sasl.jaas.config: org.apache.kafka.common.security.oauthbearer.OAuthBearerLoginModule required \
          clientId="unused" \
          clientSecret="unused";
  1. Some pods start up successfully, such as the kafka-setup-job and datahub-frontend. Other pods fail to start such as datahub-system-upgrade and datahub-gms.
  2. See error
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 2025-04-15 23:01:01,818 [main] ERROR o.s.boot.SpringApplication:859 - Application run failed
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms org.springframework.context.ApplicationContextException: Unable to start web server
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.onRefresh(ServletWebServerApplicationContext.java:165)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:619)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:146)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:754)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:456)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.SpringApplication.run(SpringApplication.java:335)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1363)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1352)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at com.linkedin.gms.GMSApplication.main(GMSApplication.java:19)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.loader.launch.Launcher.launch(Launcher.java:102)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.loader.launch.Launcher.launch(Launcher.java:64)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.loader.launch.JarLauncher.main(JarLauncher.java:40)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms Caused by: org.springframework.boot.web.server.WebServerException: Unable to start embedded Jetty web server
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.embedded.jetty.JettyWebServer.initialize(JettyWebServer.java:126)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.embedded.jetty.JettyWebServer.<init>(JettyWebServer.java:87)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.embedded.jetty.JettyServletWebServerFactory.getJettyWebServer(JettyServletWebServerFactory.java:480)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.embedded.jetty.JettyServletWebServerFactory.getWebServer(JettyServletWebServerFactory.java:194)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.createWebServer(ServletWebServerApplicationContext.java:188)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.onRefresh(ServletWebServerApplicationContext.java:162)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	... 15 common frames omitted
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'authFilter' defined in class path resource [com/linkedin/gms/ServletConfig.class]: Unsatisfied dependency expressed through method 'authFilter' parameter 0: Error creating bean with name 'authenticationFilter': Unsatisfied dependency expressed through field '_entityService': Error creating bean with name 'dataHubKafkaEventProducerFactory': Unsatisfied dependency expressed through field 'kafkaProducer': Error creating bean with name 'kafkaProducer' defined in class path resource [com/linkedin/gms/factory/kafka/DataHubKafkaProducerFactory.class]: Failed to instantiate [org.apache.kafka.clients.producer.Producer]: Factory method 'createInstance' threw exception with message: Invalid value org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler for configuration sasl.login.callback.handler.class: Class org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler could not be found.
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:795)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:542)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1355)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1185)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:562)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:522)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:337)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:335)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:205)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.ServletContextInitializerBeans.getOrderedBeansOfType(ServletContextInitializerBeans.java:210)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.ServletContextInitializerBeans.getOrderedBeansOfType(ServletContextInitializerBeans.java:201)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.ServletContextInitializerBeans.addServletContextInitializerBeans(ServletContextInitializerBeans.java:96)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.ServletContextInitializerBeans.<init>(ServletContextInitializerBeans.java:85)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.getServletContextInitializerBeans(ServletWebServerApplicationContext.java:266)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.selfInitialize(ServletWebServerApplicationContext.java:240)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.embedded.jetty.ServletContextInitializerConfiguration.callInitializers(ServletContextInitializerConfiguration.java:65)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.embedded.jetty.ServletContextInitializerConfiguration.configure(ServletContextInitializerConfiguration.java:54)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.ee10.webapp.Configurations.configure(Configurations.java:505)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.ee10.webapp.WebAppContext.configure(WebAppContext.java:480)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.ee10.webapp.WebAppContext.startContext(WebAppContext.java:1296)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.ee10.servlet.ServletContextHandler.lambda$doStart$0(ServletContextHandler.java:1047)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.server.handler.ContextHandler$ScopedContext.call(ContextHandler.java:1452)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.ee10.servlet.ServletContextHandler.doStart(ServletContextHandler.java:1044)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.ee10.webapp.WebAppContext.doStart(WebAppContext.java:499)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.server.Server.start(Server.java:641)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:120)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.server.Handler$Abstract.doStart(Handler.java:491)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.server.Server.doStart(Server.java:582)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.boot.web.embedded.jetty.JettyWebServer.initialize(JettyWebServer.java:120)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	... 20 common frames omitted
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'authenticationFilter': Unsatisfied dependency expressed through field '_entityService': Error creating bean with name 'dataHubKafkaEventProducerFactory': Unsatisfied dependency expressed through field 'kafkaProducer': Error creating bean with name 'kafkaProducer' defined in class path resource [com/linkedin/gms/factory/kafka/DataHubKafkaProducerFactory.class]: Failed to instantiate [org.apache.kafka.clients.producer.Producer]: Factory method 'createInstance' threw exception with message: Invalid value org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler for configuration sasl.login.callback.handler.class: Class org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler could not be found.
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:788)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:768)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:145)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:509)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1439)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:599)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:522)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:337)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:335)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:254)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1443)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1353)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:904)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:782)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	... 52 common frames omitted
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dataHubKafkaEventProducerFactory': Unsatisfied dependency expressed through field 'kafkaProducer': Error creating bean with name 'kafkaProducer' defined in class path resource [com/linkedin/gms/factory/kafka/DataHubKafkaProducerFactory.class]: Failed to instantiate [org.apache.kafka.clients.producer.Producer]: Factory method 'createInstance' threw exception with message: Invalid value org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler for configuration sasl.login.callback.handler.class: Class org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler could not be found.
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:788)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:768)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:145)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:509)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1439)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:599)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:522)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:337)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:335)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:409)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1355)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1185)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:562)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:522)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:337)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:335)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:313)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:254)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1443)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1353)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:785)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	... 67 common frames omitted
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'kafkaProducer' defined in class path resource [com/linkedin/gms/factory/kafka/DataHubKafkaProducerFactory.class]: Failed to instantiate [org.apache.kafka.clients.producer.Producer]: Factory method 'createInstance' threw exception with message: Invalid value org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler for configuration sasl.login.callback.handler.class: Class org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler could not be found.
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:648)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:636)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1355)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1185)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:562)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:522)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:337)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:335)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:254)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1443)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1353)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:785)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	... 92 common frames omitted
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.kafka.clients.producer.Producer]: Factory method 'createInstance' threw exception with message: Invalid value org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler for configuration sasl.login.callback.handler.class: Class org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler could not be found.
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:178)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:644)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	... 105 common frames omitted
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms Caused by: org.apache.kafka.common.config.ConfigException: Invalid value org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler for configuration sasl.login.callback.handler.class: Class org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler could not be found.
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.common.config.ConfigDef.parseType(ConfigDef.java:728)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.common.config.ConfigDef.parseValue(ConfigDef.java:474)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:467)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:108)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:129)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.clients.producer.ProducerConfig.<init>(ProducerConfig.java:481)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:326)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:270)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at com.linkedin.gms.factory.kafka.DataHubKafkaProducerFactory.createInstance(DataHubKafkaProducerFactory.java:30)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at com.linkedin.gms.factory.kafka.DataHubKafkaProducerFactory$$SpringCGLIB$$0.CGLIB$createInstance$0(<generated>)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at com.linkedin.gms.factory.kafka.DataHubKafkaProducerFactory$$SpringCGLIB$$FastClass$$1.invoke(<generated>)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:258)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:348)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at com.linkedin.gms.factory.kafka.DataHubKafkaProducerFactory$$SpringCGLIB$$0.createInstance(<generated>)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:146)
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 	... 106 common frames omitted
datahub-datahub-gms-7c6f6b9b4f-dpt87 datahub-gms 2025/04/15 23:01:01 Command exited with error: exit status 1

Expected behavior
I expect kafka to work consistently across pods.

Desktop (please complete the following information):

  • OS: Linux, Kubernetes
  • Browser: N/A
  • Version: v1.0.0

Additional context
At least two pods seem to be missing a dependency that contains org.apache.kafka.common.security.oauthbearer.secured.OAuthBearerLoginCallbackHandler so some pods work and some do not.
@plockaby-ionq plockaby-ionq added the bug Bug report label Apr 15, 2025
@plockaby-ionq plockaby-ionq changed the title A short description of the bug Kafka fails to connect with OAUTHBEARER configuration Apr 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Bug report
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@plockaby-ionq