Uploaded image for project: 'FishEye'
  1. FishEye
  2. FE-2578

fisheye loses notifications upon crowd issues

    • Icon: Bug Bug
    • Resolution: Handled by Support
    • Icon: Low Low
    • None
    • 2.2.0
    • None
    • None

      We've had some issues where someone broke Crowd (they changed the LDAP credentials it was using).

      One nasty side effect of this is that fisheye stopped sending notifications out. The real nuisance though is that all watchers appeared to be removed and needed adding back in manually.

      I've afraid I've not got the full logs anymore but I can tell you this much:

      (watcher error)
      2010-04-14 00:00:00,097 ERROR [FE-WatchChecker] fisheye.app com.cenqua.fisheye.web.WatchManager$WatchChecker-checkWatchesForRep - Could not create trusted user login for user [mikeh]. Notification skipped for this user.

            [FE-2578] fisheye loses notifications upon crowd issues

            Owen made changes -
            Workflow Original: FE-CRUC Bug Workflow [ 2944188 ] New: JAC Bug Workflow v3 [ 2957201 ]
            Owen made changes -
            Workflow Original: FECRU Development Workflow - Triage - Restricted [ 1517901 ] New: FE-CRUC Bug Workflow [ 2944188 ]
            Owen made changes -
            Workflow Original: FECRU Development Workflow - Triage [ 943080 ] New: FECRU Development Workflow - Triage - Restricted [ 1517901 ]
            Piotr Swiecicki made changes -
            Workflow Original: FECRU Development Workflow (Triage) [ 309748 ] New: FECRU Development Workflow - Triage [ 943080 ]
            Seb Ruiz (Inactive) made changes -
            Workflow Original: Simple review flow with triage [ 209771 ] New: FECRU Development Workflow (Triage) [ 309748 ]
            mwatson made changes -
            Resolution New: Handled by Support [ 8 ]
            Status Original: Needs Triage [ 10030 ] New: Closed [ 6 ]

            mwatson added a comment -

            Hi Adrian,

            Sorry for the slow response, this is our development planning instance of JIRA - for timely response on urgent matters, can you please raise a ticket at http://support.atlassian.com.

            This may be a bug, but we will close it until our support engineers can come up with a solid diagnosis.

            Matt

            mwatson added a comment - Hi Adrian, Sorry for the slow response, this is our development planning instance of JIRA - for timely response on urgent matters, can you please raise a ticket at http://support.atlassian.com . This may be a bug, but we will close it until our support engineers can come up with a solid diagnosis. Matt

            Any news on this - it's a major issue for us and could cause us to seek alternative solutions. Some more logs for your amusement (the underlying issue here is an overloaded LDAP server I believe, credentials have certainly not changed and are working).

            Thanks,

            2010-08-13 09:31:45,219 INFO [btpool0-32] fisheye.app CrowdAuth-checkPassword -
            user not found
            com.atlassian.crowd.integration.exception.InvalidAuthenticationException: [LDAP:
            error code 49 - Invalid Credentials]; nested exception is javax.naming.Authenti
            cationException: [LDAP: error code 49 - Invalid Credentials]
            at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
            at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct
            orAccessorImpl.java:39)
            at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC
            onstructorAccessorImpl.java:27)
            at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
            at org.codehaus.xfire.aegis.type.basic.BeanType.createFromFault(BeanType
            .java:235)
            at org.codehaus.xfire.aegis.type.basic.BeanType.readObject(BeanType.java
            :105)
            at org.codehaus.xfire.aegis.AegisBindingProvider.readParameter(AegisBindingProvider.java:169)
            at org.codehaus.xfire.client.ClientFaultConverter.processFaultDetail(ClientFaultConverter.java:51)
            at org.codehaus.xfire.client.ClientFaultConverter.invoke(ClientFaultConverter.java:32)
            at org.codehaus.xfire.handler.HandlerPipeline.invoke(HandlerPipeline.java:131)
            at org.codehaus.xfire.client.Client.onReceive(Client.java:424)
            at org.codehaus.xfire.transport.http.HttpChannel.sendViaClient(HttpChannel.java:139)
            at org.codehaus.xfire.transport.http.HttpChannel.send(HttpChannel.java:48)
            at org.codehaus.xfire.handler.OutMessageSender.invoke(OutMessageSender.java:26)
            at org.codehaus.xfire.handler.HandlerPipeline.invoke(HandlerPipeline.java:131)
            at org.codehaus.xfire.client.Invocation.invoke(Invocation.java:79)
            at org.codehaus.xfire.client.Invocation.invoke(Invocation.java:114)
            at org.codehaus.xfire.client.Client.invoke(Client.java:336)
            at org.codehaus.xfire.client.XFireProxy.handleRequest(XFireProxy.java:77)
            at org.codehaus.xfire.client.XFireProxy.invoke(XFireProxy.java:57)
            at $Proxy0.authenticatePrincipal(Unknown Source)
            at com.atlassian.crowd.integration.service.soap.client.SecurityServerClientImpl.authenticatePrincipal(SecurityServerClientImpl.java:221)
            at com.atlassian.crowd.integration.service.cache.AuthenticationManagerImpl.authenticate(AuthenticationManagerImpl.java:41)
            at com.atlassian.crowd.integration.http.HttpAuthenticatorImpl.authenticate(HttpAuthenticatorImpl.java:315)
            at com.cenqua.fisheye.user.crowd.CrowdAuth.checkPassword(CrowdAuth.java:105)
            at com.cenqua.fisheye.user.UserManager.loginWithSanitizedUserName(UserManager.java:358)
            at com.cenqua.fisheye.user.UserManager.login(UserManager.java:321)
            at com.cenqua.fisheye.web.LoginServlet.login(LoginServlet.java:98)
            at com.cenqua.fisheye.web.LoginServlet.doLogin(LoginServlet.java:69)
            at com.cenqua.fisheye.web.LoginServlet.doGet(LoginServlet.java:55)
            at com.cenqua.fisheye.web.LoginServlet.doPost(LoginServlet.java:47)
            at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
            at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
            at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
            at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1208)
            at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
            at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:55)
            at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:41)
            at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200)
            at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
            at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:55)
            at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:41)
            at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200)
            at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:83)
            at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
            at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200)
            at com.cenqua.crucible.filters.CrucibleFilter.doFilter(CrucibleFilter.java:141)
            at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200)
            at com.cenqua.fisheye.web.filters.TotalityFilter.doFilter(TotalityFilter.java:233)
            at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:236)
            at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
            at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200)
            at com.atlassian.security.auth.trustedapps.filter.TrustedApplicationsFilter.doFilter(TrustedApplicationsFilter.java:98)
            at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:236)
            at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
            at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200)
            at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)
            at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)
            at com.atlassian.oauth.serviceprovider.internal.servlet.OAuthFilter.doFilter(OAuthFilter.java:69)
            at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)
            ...
            Caused by: org.codehaus.xfire.fault.XFireFault: [LDAP: error code 49 - Invalid Credentials]; nested exception is javax.naming.AuthenticationException: [LDAP: error code 49 - Invalid Credentials]
            at org.codehaus.xfire.fault.Soap11FaultSerializer.readMessage(Soap11FaultSerializer.java:31)
            at org.codehaus.xfire.fault.SoapFaultSerializer.readMessage(SoapFaultSerializer.java:28)
            at org.codehaus.xfire.soap.handler.ReadHeadersHandler.checkForFault(ReadHeadersHandler.java:111)
            at org.codehaus.xfire.soap.handler.ReadHeadersHandler.invoke(ReadHeadersHandler.java:67)
            at org.codehaus.xfire.handler.HandlerPipeline.invoke(HandlerPipeline.java:131)

            Adrian Bridgett added a comment - Any news on this - it's a major issue for us and could cause us to seek alternative solutions. Some more logs for your amusement (the underlying issue here is an overloaded LDAP server I believe, credentials have certainly not changed and are working). Thanks, 2010-08-13 09:31:45,219 INFO [btpool0-32] fisheye.app CrowdAuth-checkPassword - user not found com.atlassian.crowd.integration.exception.InvalidAuthenticationException: [LDAP: error code 49 - Invalid Credentials]; nested exception is javax.naming.Authenti cationException: [LDAP: error code 49 - Invalid Credentials] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct orAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC onstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.codehaus.xfire.aegis.type.basic.BeanType.createFromFault(BeanType .java:235) at org.codehaus.xfire.aegis.type.basic.BeanType.readObject(BeanType.java :105) at org.codehaus.xfire.aegis.AegisBindingProvider.readParameter(AegisBindingProvider.java:169) at org.codehaus.xfire.client.ClientFaultConverter.processFaultDetail(ClientFaultConverter.java:51) at org.codehaus.xfire.client.ClientFaultConverter.invoke(ClientFaultConverter.java:32) at org.codehaus.xfire.handler.HandlerPipeline.invoke(HandlerPipeline.java:131) at org.codehaus.xfire.client.Client.onReceive(Client.java:424) at org.codehaus.xfire.transport.http.HttpChannel.sendViaClient(HttpChannel.java:139) at org.codehaus.xfire.transport.http.HttpChannel.send(HttpChannel.java:48) at org.codehaus.xfire.handler.OutMessageSender.invoke(OutMessageSender.java:26) at org.codehaus.xfire.handler.HandlerPipeline.invoke(HandlerPipeline.java:131) at org.codehaus.xfire.client.Invocation.invoke(Invocation.java:79) at org.codehaus.xfire.client.Invocation.invoke(Invocation.java:114) at org.codehaus.xfire.client.Client.invoke(Client.java:336) at org.codehaus.xfire.client.XFireProxy.handleRequest(XFireProxy.java:77) at org.codehaus.xfire.client.XFireProxy.invoke(XFireProxy.java:57) at $Proxy0.authenticatePrincipal(Unknown Source) at com.atlassian.crowd.integration.service.soap.client.SecurityServerClientImpl.authenticatePrincipal(SecurityServerClientImpl.java:221) at com.atlassian.crowd.integration.service.cache.AuthenticationManagerImpl.authenticate(AuthenticationManagerImpl.java:41) at com.atlassian.crowd.integration.http.HttpAuthenticatorImpl.authenticate(HttpAuthenticatorImpl.java:315) at com.cenqua.fisheye.user.crowd.CrowdAuth.checkPassword(CrowdAuth.java:105) at com.cenqua.fisheye.user.UserManager.loginWithSanitizedUserName(UserManager.java:358) at com.cenqua.fisheye.user.UserManager.login(UserManager.java:321) at com.cenqua.fisheye.web.LoginServlet.login(LoginServlet.java:98) at com.cenqua.fisheye.web.LoginServlet.doLogin(LoginServlet.java:69) at com.cenqua.fisheye.web.LoginServlet.doGet(LoginServlet.java:55) at com.cenqua.fisheye.web.LoginServlet.doPost(LoginServlet.java:47) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502) at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1208) at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46) at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:55) at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:41) at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200) at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46) at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:55) at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:41) at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:83) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200) at com.cenqua.crucible.filters.CrucibleFilter.doFilter(CrucibleFilter.java:141) at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200) at com.cenqua.fisheye.web.filters.TotalityFilter.doFilter(TotalityFilter.java:233) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:236) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167) at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200) at com.atlassian.security.auth.trustedapps.filter.TrustedApplicationsFilter.doFilter(TrustedApplicationsFilter.java:98) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:236) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167) at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1200) at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46) at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66) at com.atlassian.oauth.serviceprovider.internal.servlet.OAuthFilter.doFilter(OAuthFilter.java:69) at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74) ... Caused by: org.codehaus.xfire.fault.XFireFault: [LDAP: error code 49 - Invalid Credentials] ; nested exception is javax.naming.AuthenticationException: [LDAP: error code 49 - Invalid Credentials] at org.codehaus.xfire.fault.Soap11FaultSerializer.readMessage(Soap11FaultSerializer.java:31) at org.codehaus.xfire.fault.SoapFaultSerializer.readMessage(SoapFaultSerializer.java:28) at org.codehaus.xfire.soap.handler.ReadHeadersHandler.checkForFault(ReadHeadersHandler.java:111) at org.codehaus.xfire.soap.handler.ReadHeadersHandler.invoke(ReadHeadersHandler.java:67) at org.codehaus.xfire.handler.HandlerPipeline.invoke(HandlerPipeline.java:131)
            Adrian Bridgett created issue -

              Unassigned Unassigned
              9e03ed0c7036 Adrian Bridgett
              Affected customers:
              0 This affects my team
              Watchers:
              0 Start watching this issue

                Created:
                Updated:
                Resolved: