#805  Git clone/push error on large repositories
Closed
dim opened 2 years ago
2022-07-07 19:41:44,058 ERROR [qtp1520295349-103353] io.onedev.server.git.GitFilter Error serving git request
io.onedev.server.git.exception.GitException: Unable to find project 'testmanage'
	at io.onedev.server.git.GitFilter.getProject(GitFilter.java:109)
	at io.onedev.server.git.GitFilter.processRefs(GitFilter.java:276)
	at io.onedev.server.git.GitFilter.doFilter(GitFilter.java:321)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
	at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
	at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
	at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
	at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
	at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
	at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
	at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:450)
	at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
	at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
	at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
	at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:387)
	at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
	at io.onedev.server.util.jetty.DisableTraceFilter.doFilter(DisableTraceFilter.java:28)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:516)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:386)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
	at java.lang.Thread.run(Thread.java:748)
2022-07-07 19:53:13,854 ERROR [qtp1520295349-120388] io.onedev.server.git.GitFilter Error serving git request
io.onedev.server.git.exception.GitException: Unable to find project 'testmanage'
	at io.onedev.server.git.GitFilter.getProject(GitFilter.java:109)
	at io.onedev.server.git.GitFilter.processRefs(GitFilter.java:276)
	at io.onedev.server.git.GitFilter.doFilter(GitFilter.java:321)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
	at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
	at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
	at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
	at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
	at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
	at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
	at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:450)
	at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
	at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
	at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
	at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:387)
	at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
	at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
	at io.onedev.server.util.jetty.DisableTraceFilter.doFilter(DisableTraceFilter.java:28)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:516)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:386)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
	at java.lang.Thread.run(Thread.java:748)

需要怎么处理一下?

Robin Shen changed fields 2 years ago
Name Previous Value Current Value
Type
Bug
Support Request
Robin Shen commented 2 years ago

检查下你是否有什么脚本定期从这个项目进行 pull

Robin Shen changed state to 'Closed' 2 years ago
Previous Value Current Value
Open
Closed
Robin Shen commented 2 years ago

Closing as there is no further input.

Jiung changed state to 'Open' 1 year ago
Previous Value Current Value
Closed
Open
Jiung commented 1 year ago

I am keep facing same error messages when push, and even do nothing. Can you check why it happens?

ERROR io.onedev.server.util.ExceptionUtils - Error serving request java.lang.IllegalArgumentException: The request should have either 'pageId' or 'resourceName' parameter! at org.apache.wicket.protocol.ws.api.AbstractWebSocketProcessor.(AbstractWebSocketProcessor.java:122) at io.onedev.server.web.websocket.WebSocketProcessor.(WebSocketProcessor.java:61) at io.onedev.server.web.websocket.WebSocketFilter$1.createWebSocket(WebSocketFilter.java:64) at org.eclipse.jetty.websocket.server.WebSocketServerFactory.acceptWebSocket(WebSocketServerFactory.java:230) at org.eclipse.jetty.websocket.server.WebSocketServerFactory.acceptWebSocket(WebSocketServerFactory.java:215) at io.onedev.server.web.websocket.WebSocketFilter.acceptWebSocket(WebSocketFilter.java:81) at org.apache.wicket.protocol.ws.AbstractUpgradeFilter.processRequestCycle(AbstractUpgradeFilter.java:66) at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:203) at org.apache.wicket.protocol.http.WicketServlet.doGet(WicketServlet.java:137) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.onedev.server.web.DefaultWicketServlet.service(DefaultWicketServlet.java:43) at io.onedev.server.persistence.SessionInterceptor$1.call(SessionInterceptor.java:23) at io.onedev.server.persistence.DefaultSessionManager.call(DefaultSessionManager.java:90) at io.onedev.server.persistence.SessionInterceptor.invoke(SessionInterceptor.java:18) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1626) at com.google.inject.servlet.DefaultFilterPipeline.dispatch(DefaultFilterPipeline.java:47) at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:133) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GoGetFilter.doFilter(GoGetFilter.java:87) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GitLfsFilter.doFilter(GitLfsFilter.java:511) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GitFilter.doFilter(GitFilter.java:394) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66) at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:458) at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:373) at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90) at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83) at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:387) at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:370) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.jetty.DisableTraceFilter.doFilter(DisableTraceFilter.java:28) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.base/java.lang.Thread.run(Thread.java:829)

Robin Shen commented 1 year ago

Please let me know your version

Jiung commented 1 year ago

It is 7.8.15 image.png

Jiung commented 1 year ago

And it happens after Pull, or push done. Not sure its meaning

Robin Shen commented 1 year ago

I guess you are using reverse proxy. In this case, please change websocket proxy path from server to ~server. For details, please check:

https://docs.onedev.io/administration-guide/reverse-proxy-setup

Jiung commented 1 year ago

Ah, you are right. We are now using reverse proxy, and will do as you comment! Thanks.

Jiung commented 1 year ago

Not sure it happens again, but now I am changing my NPM settings as like below. If is there someone like me (having Ngnix Proxy Manager to rever proxy from other server), please refer this

image_2.png

Jiung commented 1 year ago

Hm.. happens again

/root/bin/entrypoint.sh: line 31: 55 Killed java -cp "../boot/*" ${MEM_OPTIONS} ${MOD_OPTIONS} io.onedev.commons.bootstrap.Bootstrap INFO - Launching application from '/app'... INFO - Cleaning temp directory... INFO - Starting server... INFO - *********** Successfully checked /opt/onedev ************ INFO - Stoppping server... 08:01:40 INFO i.onedev.commons.bootstrap.Bootstrap - Launching application from '/opt/onedev'... 08:01:40 INFO i.onedev.commons.bootstrap.Bootstrap - Cleaning temp directory... 08:01:42 INFO io.onedev.commons.loader.AppLoader - Starting server... 08:01:56 INFO i.o.s.e.impl.DefaultProjectManager - Checking projects... 08:02:00 INFO i.o.s.e.impl.DefaultIssueManager - Caching issue info... 08:02:00 INFO i.o.s.e.i.DefaultBuildParamManager - Caching build param info... 08:02:00 INFO i.o.s.e.i.DefaultBuildMetricManager - Caching build metric info... 08:02:01 INFO i.o.s.e.i.DefaultAgentAttributeManager - Caching agent attribute info... 08:02:01 INFO i.o.s.e.impl.DefaultBuildManager - Caching build info... 08:02:01 INFO io.onedev.server.OneDev - Server is ready at http://localhost:6610. 08:02:09 ERROR i.o.s.u.c.DefaultBatchWorkManager - Error doing works io.onedev.commons.utils.ExplicitException: Failed to run command: git diff --numstat --no-renames b5889c1736853a854ffdf07cebbdd111cf0bb1e7..d36ddf6c83d1ddbb2599ecfcdf3777aa126343e7, return code: 137 at io.onedev.commons.utils.command.ExecutionResult.buildException(ExecutionResult.java:54) at io.onedev.commons.utils.command.ExecutionResult.checkReturnCode(ExecutionResult.java:62) at io.onedev.server.git.command.ListNumStatsCommand.run(ListNumStatsCommand.java:63) at io.onedev.server.infomanager.DefaultCommitInfoManager$10.execute(DefaultCommitInfoManager.java:761) at jetbrains.exodus.env.EnvironmentImpl.executeInTransaction(EnvironmentImpl.java:1160) at jetbrains.exodus.env.EnvironmentImpl.executeInTransaction(EnvironmentImpl.java:301) at io.onedev.server.infomanager.DefaultCommitInfoManager.collectLineStats(DefaultCommitInfoManager.java:744) at io.onedev.server.infomanager.DefaultCommitInfoManager.doCollect(DefaultCommitInfoManager.java:469) at io.onedev.server.infomanager.DefaultCommitInfoManager$17$1.run(DefaultCommitInfoManager.java:1148) at io.onedev.server.persistence.DefaultSessionManager$2.call(DefaultSessionManager.java:111) at io.onedev.server.persistence.DefaultSessionManager$2.call(DefaultSessionManager.java:107) at io.onedev.server.persistence.DefaultSessionManager.call(DefaultSessionManager.java:90) at io.onedev.server.persistence.DefaultSessionManager.run(DefaultSessionManager.java:107) at jdk.internal.reflect.GeneratedMethodAccessor50.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.google.inject.internal.DelegatingInvocationHandler.invoke(DelegatingInvocationHandler.java:50) at com.sun.proxy.$Proxy26.run(Unknown Source) at io.onedev.server.infomanager.DefaultCommitInfoManager$17.doWorks(DefaultCommitInfoManager.java:1137) at io.onedev.server.util.concurrent.DefaultBatchWorkManager$2.doWorks(DefaultBatchWorkManager.java:110) at io.onedev.server.util.concurrent.DefaultBatchWorkManager$1.run(DefaultBatchWorkManager.java:78) at io.onedev.server.util.concurrent.DefaultWorkExecutor$3.call(DefaultWorkExecutor.java:210) at io.onedev.server.util.concurrent.DefaultWorkExecutor$3.call(DefaultWorkExecutor.java:206) at io.onedev.server.security.SecurityUtils$3.call(SecurityUtils.java:393) at io.onedev.server.util.concurrent.DefaultWorkExecutor$2.call(DefaultWorkExecutor.java:79) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at io.onedev.server.security.SecurityUtils$1.run(SecurityUtils.java:367) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829)

Robin Shen commented 1 year ago

Do you mean pull/push still does not work?

Jiung commented 1 year ago

I applied those settings before reboot

git config --global pack.windowMemory "200m"

git config --global pack.packSizeLimit "200m"

git config --global pack.threads "1"

git config --global pack.window "0"

git config --global http.postBuffer 1048576000

Jiung commented 1 year ago

Nope, server is crashed after pull/push. And sometimes clone is not working due to big repository. I guess I need to setup git config things whenever onedev docker reboots

Jiung commented 1 year ago

FYI, I am using docker container as below

docker run --name onedev -d --restart always -v//var/run/docker.sock:/var/run/docker.sock -v localpath:/opt/onedev -p 6610:6610 -p 6611:6611 1dev/server

Jiung commented 1 year ago

And NPM proxy setting for this domain

image_3.png

Robin Shen commented 1 year ago

How large is your git repository?

Jiung commented 1 year ago

Now local repo is 3GB.

Robin Shen commented 1 year ago
Failed to run command: git diff --numstat --no-renames b5889c1736853a854ffdf07cebbdd111cf0bb1e7..d36ddf6c83d1ddbb2599ecfcdf3777aa126343e7, return code: 137

This command requires more memory for your size of repository.

Robin Shen changed title 1 year ago
Previous Value Current Value
我删了一个项目,日志一直报GitFilter Error serving git request
Git clone/push error
Jiung commented 1 year ago

After trying to move to new instance, but I got keep same error

ERROR io.onedev.server.util.ExceptionUtils - Error serving request java.lang.IllegalArgumentException: The request should have either 'pageId' or 'resourceName' parameter!

It keeps happening per every minute.

And from Ngnix reverse proxy setting, if I add proxy_http_version 1.1; then it must fail from ngnix side. (Not working..)

So I just added custom script for except proxy_http_version

client_max_body_size 300M;

proxy_set_header Upgrade $http_upgrade; proxy_set_header Connection "upgrade";

and setup custom locations in your documents. Is there anything that I could try?

Robin Shen commented 1 year ago

Please run this command manually from terminal on your repository to see how much memory is requires:

git diff --numstat --no-renames b5889c1736853a854ffdf07cebbdd111cf0bb1e7..d36ddf6c83d1ddbb2599ecfcdf3777aa126343e7
Jiung commented 1 year ago

Okay, here is I got. I sum up every numbers for each rows, so 2,621,254(biggest is 497144) / 110,376 (biggest is 84253) is I got.

image_4.png

Ram size is 3GB now

Robin Shen commented 1 year ago

You will allocate at least twice of the memory required by this command to OneDev server. After doing that, please restart OneDev server, and check if there are any errors printed in console log before trying pull/push.

Jiung commented 1 year ago

Hm.. Yep. I restart instances but error message is still same

04:06:23 INFO io.onedev.commons.loader.AppLoader - Stopping server... INFO - Launching application from '/app'... INFO - Cleaning temp directory... INFO - Starting server... INFO - *********** Successfully checked /opt/onedev ************ INFO - Stopping server... 04:06:29 INFO i.onedev.commons.bootstrap.Bootstrap - Launching application from '/opt/onedev'... 04:06:29 INFO i.onedev.commons.bootstrap.Bootstrap - Cleaning temp directory... 04:06:32 INFO io.onedev.commons.loader.AppLoader - Starting server... 04:06:42 INFO i.o.s.e.impl.DefaultProjectManager - Checking projects... 04:06:44 INFO i.o.s.e.i.DefaultBuildParamManager - Caching build param info... 04:06:44 INFO i.o.s.e.i.DefaultAgentAttributeManager - Caching agent attribute info... 04:06:44 INFO i.o.s.e.impl.DefaultIssueManager - Caching issue info... 04:06:45 INFO i.o.s.e.i.DefaultBuildMetricManager - Caching build metric info... 04:06:47 INFO i.o.s.e.impl.DefaultBuildManager - Caching build info... 04:06:47 INFO io.onedev.server.OneDev - Server is ready at http://localhost:6610. 04:06:53 ERROR i.o.s.u.c.DefaultBatchWorkManager - Error doing works io.onedev.commons.utils.ExplicitException: Failed to run command: git diff --numstat --no-renames b5889c1736853a854ffdf07cebbdd111cf0bb1e7..f37aa149815ca7b8735de9626dffd6cc06debb06, return code: 137 at io.onedev.commons.utils.command.ExecutionResult.buildException(ExecutionResult.java:54) at io.onedev.commons.utils.command.ExecutionResult.checkReturnCode(ExecutionResult.java:62) at io.onedev.server.git.command.ListNumStatsCommand.run(ListNumStatsCommand.java:63) at io.onedev.server.infomanager.DefaultCommitInfoManager$10.execute(DefaultCommitInfoManager.java:761) at jetbrains.exodus.env.EnvironmentImpl.executeInTransaction(EnvironmentImpl.java:1160) at jetbrains.exodus.env.EnvironmentImpl.executeInTransaction(EnvironmentImpl.java:301) at io.onedev.server.infomanager.DefaultCommitInfoManager.collectLineStats(DefaultCommitInfoManager.java:744) at io.onedev.server.infomanager.DefaultCommitInfoManager.doCollect(DefaultCommitInfoManager.java:469) at io.onedev.server.infomanager.DefaultCommitInfoManager$17$1.run(DefaultCommitInfoManager.java:1148) at io.onedev.server.persistence.DefaultSessionManager$2.call(DefaultSessionManager.java:111) at io.onedev.server.persistence.DefaultSessionManager$2.call(DefaultSessionManager.java:107) at io.onedev.server.persistence.DefaultSessionManager.call(DefaultSessionManager.java:90) at io.onedev.server.persistence.DefaultSessionManager.run(DefaultSessionManager.java:107) at jdk.internal.reflect.GeneratedMethodAccessor49.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.google.inject.internal.DelegatingInvocationHandler.invoke(DelegatingInvocationHandler.java:50) at com.sun.proxy.$Proxy26.run(Unknown Source) at io.onedev.server.infomanager.DefaultCommitInfoManager$17.doWorks(DefaultCommitInfoManager.java:1137) at io.onedev.server.util.concurrent.DefaultBatchWorkManager$2.doWorks(DefaultBatchWorkManager.java:110) at io.onedev.server.util.concurrent.DefaultBatchWorkManager$1.run(DefaultBatchWorkManager.java:78) at io.onedev.server.util.concurrent.DefaultWorkExecutor$3.call(DefaultWorkExecutor.java:210) at io.onedev.server.util.concurrent.DefaultWorkExecutor$3.call(DefaultWorkExecutor.java:206) at io.onedev.server.security.SecurityUtils$3.call(SecurityUtils.java:393) at io.onedev.server.util.concurrent.DefaultWorkExecutor$2.call(DefaultWorkExecutor.java:79) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at io.onedev.server.security.SecurityUtils$1.run(SecurityUtils.java:367) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829)

04:06:53 ERROR io.onedev.server.util.ExceptionUtils - Error serving request java.lang.IllegalArgumentException: The request should have either 'pageId' or 'resourceName' parameter! at org.apache.wicket.protocol.ws.api.AbstractWebSocketProcessor.(AbstractWebSocketProcessor.java:122) at io.onedev.server.web.websocket.WebSocketProcessor.(WebSocketProcessor.java:61) at io.onedev.server.web.websocket.WebSocketFilter$1.createWebSocket(WebSocketFilter.java:64) at org.eclipse.jetty.websocket.server.WebSocketServerFactory.acceptWebSocket(WebSocketServerFactory.java:230) at org.eclipse.jetty.websocket.server.WebSocketServerFactory.acceptWebSocket(WebSocketServerFactory.java:215) at io.onedev.server.web.websocket.WebSocketFilter.acceptWebSocket(WebSocketFilter.java:81) at org.apache.wicket.protocol.ws.AbstractUpgradeFilter.processRequestCycle(AbstractUpgradeFilter.java:66) at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:203) at org.apache.wicket.protocol.http.WicketServlet.doGet(WicketServlet.java:137) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.onedev.server.web.DefaultWicketServlet.service(DefaultWicketServlet.java:43) at io.onedev.server.persistence.SessionInterceptor$1.call(SessionInterceptor.java:23) at io.onedev.server.persistence.DefaultSessionManager.call(DefaultSessionManager.java:90) at io.onedev.server.persistence.SessionInterceptor.invoke(SessionInterceptor.java:18) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1626) at com.google.inject.servlet.DefaultFilterPipeline.dispatch(DefaultFilterPipeline.java:47) at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:133) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GoGetFilter.doFilter(GoGetFilter.java:87) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GitLfsFilter.doFilter(GitLfsFilter.java:511) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GitFilter.doFilter(GitFilter.java:394) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66) at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:458) at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:373) at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90) at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83) at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:387) at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:370) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.jetty.DisableTraceFilter.doFilter(DisableTraceFilter.java:28) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.base/java.lang.Thread.run(Thread.java:829)

04:07:06 ERROR io.onedev.server.util.ExceptionUtils - Error serving request java.lang.IllegalArgumentException: The request should have either 'pageId' or 'resourceName' parameter!

04:07:36 ERROR io.onedev.server.util.ExceptionUtils - Error serving request java.lang.IllegalArgumentException: The request should have either 'pageId' or 'resourceName' parameter!

"java.lang.IllegalArgumentException: The request should have either 'pageId' or 'resourceName' parameter!" Error is now happening at every 30 seconds.

Robin Shen commented 1 year ago

Error code 137 means out of memory. While OneDev server container is running, please login into the container by running docker exec -it --rm <onedev container id> and run that same git diff command against the repository (/opt/onedev/site/projects/<project id>/git) to see if the error still exists.

Robin Shen commented 1 year ago

Should be using docker exec -it --rm <onedev container id> bash to login into OneDev container

Jiung commented 1 year ago

Okay, I got failure with another error, and server got rebooted.

Caused by: io.onedev.commons.utils.ExplicitException: Failed to run command: git upload-pack --stateless-rpc ., return code: 128 error: pack-objects died of signal 9 error: git upload-pack: git-pack-objects died with error. fatal: git upload-pack: aborting due to possible repository corruption on the remote side. at io.onedev.commons.utils.command.ExecutionResult.buildException(ExecutionResult.java:54) at io.onedev.server.git.CommandUtils.uploadPack(CommandUtils.java:164) at io.onedev.server.git.GitFilter$3.run(GitFilter.java:194) at io.onedev.server.util.concurrent.DefaultWorkExecutor$3.call(DefaultWorkExecutor.java:210) at io.onedev.server.util.concurrent.DefaultWorkExecutor$3.call(DefaultWorkExecutor.java:206) at io.onedev.server.security.SecurityUtils$3.call(SecurityUtils.java:393) at io.onedev.server.util.concurrent.DefaultWorkExecutor$2.call(DefaultWorkExecutor.java:79) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at io.onedev.server.security.SecurityUtils$1.run(SecurityUtils.java:367) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ... 1 common frames omitted 05:00:19 ERROR io.onedev.server.util.ExceptionUtils - Error serving request java.lang.IllegalArgumentException: The request should have either 'pageId' or 'resourceName' parameter! at org.apache.wicket.protocol.ws.api.AbstractWebSocketProcessor.(AbstractWebSocketProcessor.java:122) at io.onedev.server.web.websocket.WebSocketProcessor.(WebSocketProcessor.java:61) at io.onedev.server.web.websocket.WebSocketFilter$1.createWebSocket(WebSocketFilter.java:64) at org.eclipse.jetty.websocket.server.WebSocketServerFactory.acceptWebSocket(WebSocketServerFactory.java:230) at org.eclipse.jetty.websocket.server.WebSocketServerFactory.acceptWebSocket(WebSocketServerFactory.java:215) at io.onedev.server.web.websocket.WebSocketFilter.acceptWebSocket(WebSocketFilter.java:81) at org.apache.wicket.protocol.ws.AbstractUpgradeFilter.processRequestCycle(AbstractUpgradeFilter.java:66) at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:203) at org.apache.wicket.protocol.http.WicketServlet.doGet(WicketServlet.java:137) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.onedev.server.web.DefaultWicketServlet.service(DefaultWicketServlet.java:43) at io.onedev.server.persistence.SessionInterceptor$1.call(SessionInterceptor.java:23) at io.onedev.server.persistence.DefaultSessionManager.call(DefaultSessionManager.java:90) at io.onedev.server.persistence.SessionInterceptor.invoke(SessionInterceptor.java:18) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1626) at com.google.inject.servlet.DefaultFilterPipeline.dispatch(DefaultFilterPipeline.java:47) at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:133) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GoGetFilter.doFilter(GoGetFilter.java:87) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GitLfsFilter.doFilter(GitLfsFilter.java:511) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.git.GitFilter.doFilter(GitFilter.java:394) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66) at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:458) at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:373) at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90) at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83) at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:387) at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:370) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:154) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at io.onedev.server.jetty.DisableTraceFilter.doFilter(DisableTraceFilter.java:28) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:386) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.base/java.lang.Thread.run(Thread.java:829) /root/bin/entrypoint.sh: line 31: 55 Killed java -cp "../boot/*" ${MEM_OPTIONS} ${MOD_OPTIONS} io.onedev.commons.bootstrap.Bootstrap INFO - Launching application from '/app'... INFO - Cleaning temp directory... INFO - Starting server...

Jiung commented 1 year ago

And I used this command to compare

git diff --numstat --no-renames /opt/onedev/site/projects/3 /opt/onedev/site/projects/19

19 is backup copy of project 3. So there wasn't meaningful numbers..

Robin Shen commented 1 year ago

I don't know what is purpose of running this command. But the original command failed to execute in log is:

git diff --numstat --no-renames b5889c1736853a854ffdf07cebbdd111cf0bb1e7..f37aa149815ca7b8735de9626dffd6cc06debb06
Jiung commented 1 year ago

Me too. Don't have idea why onedev did git diff, but anyway it makes some errors.

Robin Shen commented 1 year ago

I mean instead of running command git diff --numstat --no-renames /opt/onedev/site/projects/3 /opt/onedev/site/projects/19, please run command git diff --numstat --no-renames b5889c1736853a854ffdf07cebbdd111cf0bb1e7..f37aa149815ca7b8735de9626dffd6cc06debb06 instead, as this is the exact command failed in log.

What I suggest is to run this exact command in OneDev container to see why it is failing.

Jiung commented 1 year ago

Sorry for making confusion

/opt/onedev/site/projects/3/git# git diff --numstat --no-renames b5889c1736853a854ffdf07cebbdd111cf0bb1e7..f37aa149815ca7b8735de9626dffd6cc06debb06 Killed

Jiung commented 1 year ago

And... I was trying to restore with new instances but now facing another serious error

When entered Repo and go code compare, then I should see this error (and push/pull isnt working)

java.util.concurrent.ExecutionException: io.onedev.commons.utils.ExplicitException: Failed to run command: git rev-list ^f37aa149815ca7b8735de9626dffd6cc06debb06 f37aa149815ca7b8735de9626dffd6cc06debb06 -50 -i --, return code: 128 fatal: detected dubious ownership in repository at '/opt/onedev/site/projects/3/git' To add an exception for this directory, call: git config --global --add safe.directory /opt/onedev/site/projects/3/git

After using git config --global --add safe.directory /opt/onedev/site/projects/3/git

Server log

Caused by: io.onedev.commons.utils.ExplicitException: Failed to run command: git rev-list ^f37aa149815ca7b8735de9626dffd6cc06debb06 f37aa149815ca7b8735de9626dffd6cc06debb06 -50 -i --, return code: 128 fatal: detected dubious ownership in repository at '/opt/onedev/site/projects/3/git' To add an exception for this directory, call:

Robin Shen commented 1 year ago

Looks to me some permission of the repository is screwed up. Before going further, please follow me to investigate the issue step by step. Firstable, let's run OneDev outside of docker. You will need to install jdk 11 or higher on the machine running OneDev first.

Robin Shen commented 1 year ago

Or if you have some form of online meeting facility, you can set up one so that we can check the issue online to be efficient.

Jiung commented 1 year ago

Okay then I would like to have online meeting would be nice. Thank you so much for your support

Jiung commented 1 year ago

Thank you very much for your great support

And here is fix for large repo that wasn't work

  • Executing service as Java
  • using git

git config --global pack.windowMemory "200m" git config --global pack.packSizeLimit "200m" git config --global pack.threads "1" git config --global pack.window "0" git config --global http.postBuffer 1048576000

Sorry for sudden calling from partners TT but your support was greatly appreciated

Robin Shen changed title 1 year ago
Previous Value Current Value
Git clone/push error
Git clone/push error on large repositories
Robin Shen commented 1 year ago

Thanks for sharing the git config options. Will test more with large repositories.

Jiung commented 1 year ago

Thank you for your great support again. And I've created new card for Ngnix setup so please check this when you are available

https://code.onedev.io/onedev/server/~issues/1060

Robin Shen changed state to 'Closed' 1 year ago
Previous Value Current Value
Open
Closed
Robin Shen commented 1 year ago

An issue is created to be able to config various git pack options via web UI:

Issue #1062 - Configure git pack options via web UI

issue 1 of 1
Type
Question
Priority
Normal
Assignee
Issue Votes (0)
Watchers (6)
Reference
onedev/server#805
Please wait...
Page is in error, reload to recover