Server error

Claudio Carrasco2 years ago

Hi to everyone!

I am having the following problem with my server:

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>503 Service Unavailable</title>
</head><body>
<h1>Service Unavailable</h1>
<p>The server is temporarily unable to service your
request due to maintenance downtime or capacity
problems. Please try again later.</p>
<hr>
<address>Apache/2.4.29 (Ubuntu) Server at "myserver" Port 443</address>
</body></html>

The server has been working fine for months with approximately 90 devices online, How Can I fix that?

Regards

Anton Tananaev2 years ago

Have you checked the server or you want us to guess the problem?

Claudio Carrasco2 years ago

Thanks Anton and Sorry, here is the logs:

Traccar log (nothing weird):

2022-01-30 17:55:11  INFO: [28c99130] connected
2022-01-30 17:55:12  INFO: [0dc2a4f2] connected
2022-01-30 17:55:12  INFO: [fdbcca75: h02 < 181.42.11.194] HEX: 2a48512c393137323037313834392c56312c3136353530392c412c333734382e363932312c532c30373332332e363234392c572c3030302e30302c3134352c3330303132322c46464646464246462c3733302c30312c$
2022-01-30 17:55:12  INFO: [fdbcca75: h02 > 181.42.11.194] HEX: 2a48512c393137323037313834392c56342c56312c323032323031333031363535313223
2022-01-30 17:55:12  INFO: [fdbcca75] id: 9172071849, time: 2022-01-30 17:55:09, lat: -37.81154, lon: -73.39375, course: 145.0
2022-01-30 17:55:12  INFO: [df2e6919] connected
2022-01-30 17:55:12  INFO: [fba1033e: h02 < 186.11.83.97] HEX: 2a48512c393137323038323235362c56312c3136353530372c412c333730312e303736332c532c30373330392e363930332c572c3030302e30302c3238302c3330303132322c46464646464246462c3733302c30312c3$
2022-01-30 17:55:12  INFO: [fba1033e: h02 > 186.11.83.97] HEX: 2a48512c393137323038323235362c56342c56312c323032323031333031363535313223
2022-01-30 17:55:12  INFO: [fba1033e] id: 9172082256, time: 2022-01-30 17:55:07, lat: -37.01794, lon: -73.16151, course: 280.0
2022-01-30 17:55:12  INFO: [b8273e9d: h02 < 186.11.96.237] HEX: 2a48512c393137303938353636382c56312c3136353531302c412c333635362e383132332c532c30373330302e353832352c572c3030302e30302c3231382c3330303132322c46464646424246462c3733302c30312c$
2022-01-30 17:55:12  INFO: [b8273e9d: h02 > 186.11.96.237] HEX: 2a48512c393137303938353636382c56342c56312c323032323031333031363535313223
2022-01-30 17:55:12  INFO: [b8273e9d] id: 9170985668, time: 2022-01-30 17:55:10, lat: -36.94687, lon: -73.00971, course: 218.0
2022-01-30 17:55:12  WARN: [fdbcca75] error - Connection reset by peer - IOException (...)
2022-01-30 17:55:12  INFO: [fdbcca75] disconnected
2022-01-30 17:55:12  WARN: [b8273e9d] error - Connection reset by peer - IOException (...)
2022-01-30 17:55:12  INFO: [b8273e9d] disconnected
2022-01-30 17:55:12  WARN: [fba1033e] error - Connection reset by peer - IOException (...)
2022-01-30 17:55:12  INFO: [fba1033e] disconnected
2022-01-30 17:55:13  INFO: [86169abb: h02 < 181.43.228.129] HEX: 2a48512c393137313033343034382c56312c3136353531312c412c333730372e373735392c532c30373231312e333436322c572c3030302e30302c3230302c3330303132322c46464646424246462c3733302c30312$
2022-01-30 17:55:13  INFO: [86169abb: h02 > 181.43.228.129] HEX: 2a48512c393137313033343034382c56342c56312c323032323031333031363535313323
2022-01-30 17:55:13  INFO: [86169abb] id: 9171034048, time: 2022-01-30 17:55:11, lat: -37.12960, lon: -72.18910, course: 200.0
2022-01-30 17:55:13  WARN: [86169abb] error - Connection reset by peer - IOException (...)
2022-01-30 17:55:13  INFO: [86169abb] disconnected
2022-01-30 17:55:13  INFO: [67656229] connected
2022-01-30 17:55:14  INFO: [0dc2a4f2: h02 < 181.42.45.150] HEX: 2a48512c393137313532363336312c56312c3136353530382c412c333634382e343835362c532c30373330322e303330322c572c3030302e30302c3134322c3330303132322c46424646464246462c3733302c30312c$
2022-01-30 17:55:14  INFO: [0dc2a4f2: h02 > 181.42.45.150] HEX: 2a48512c393137313532363336312c56342c56312c323032323031333031363535313423
2022-01-30 17:55:14  INFO: [0dc2a4f2] id: 9171526361, time: 2022-01-30 17:55:08, lat: -36.80809, lon: -73.03384, course: 142.0
2022-01-30 17:55:14  INFO: [5e6dfa23] connected
2022-01-30 17:55:14  INFO: [d39754cf: h02 < 186.11.5.222] HEX: 2a48512c393137313034313438312c56312c3136353531322c412c333634382e343032362c532c30373330352e333331372c572c3030322e34382c3036382c3330303132322c46464646424246462c3733302c30312c3$
2022-01-30 17:55:14  INFO: [d39754cf: h02 > 186.11.5.222] HEX: 2a48512c393137313034313438312c56342c56312c323032323031333031363535313423
2022-01-30 17:55:14  INFO: [d39754cf] id: 9171041481, time: 2022-01-30 17:55:12, lat: -36.80671, lon: -73.08886, speed: 2.5, course: 68.0
2022-01-30 17:55:14  INFO: [7aa17497] connected

Apache2 error.log:

[Sun Jan 30 06:25:01.638490 2022] [mpm_event:notice] [pid 8114:tid 140683934120896] AH00489: Apache/2.4.29 (Ubuntu) OpenSSL/1.1.1 configured -- resuming normal operations
[Sun Jan 30 06:25:01.638530 2022] [core:notice] [pid 8114:tid 140683934120896] AH00094: Command line: '/usr/sbin/apache2'
[Sun Jan 30 07:38:40.739768 2022] [core:error] [pid 4428:tid 140683815790336] [client 45.146.165.37:47992] AH00126: Invalid URI in request POST /cgi-bin/.%2e/.%2e/.%2e/.%2e/bin/sh HTTP/1.1
[Sun Jan 30 11:55:10.706727 2022] [proxy:warn] [pid 4350:tid 140683658618624] [client 185.180.143.79:33050] AH01144: No protocol handler was valid for the URL / (scheme 'http'). If you are using a DSO version of mod_proxy, make sure the$
[Sun Jan 30 12:24:05.437398 2022] [proxy:error] [pid 4428:tid 140683616655104] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:24:05.437537 2022] [proxy_http:error] [pid 4428:tid 140683616655104] [client 201.186.233.28:56353] AH01114: HTTP: failed to make connection to backend: httpd-UDS
[Sun Jan 30 12:27:18.019791 2022] [proxy:error] [pid 4428:tid 140683692189440] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:27:18.019909 2022] [proxy_http:error] [pid 4428:tid 140683692189440] [client 109.237.103.38:54580] AH01114: HTTP: failed to make connection to backend: httpd-UDS
[Sun Jan 30 12:30:55.252284 2022] [proxy:error] [pid 4428:tid 140683599869696] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:30:55.252383 2022] [proxy_http:error] [pid 4428:tid 140683599869696] [client 190.5.41.126:20776] AH01114: HTTP: failed to make connection to backend: httpd-UDS
[Sun Jan 30 12:31:00.681985 2022] [proxy:error] [pid 4428:tid 140683608262400] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:31:00.682040 2022] [proxy_http:error] [pid 4428:tid 140683608262400] [client 190.5.41.126:20975] AH01114: HTTP: failed to make connection to backend: httpd-UDS
[Sun Jan 30 12:31:06.902571 2022] [proxy:error] [pid 4428:tid 140683549513472] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:31:06.902646 2022] [proxy_http:error] [pid 4428:tid 140683549513472] [client 190.5.41.126:21024] AH01114: HTTP: failed to make connection to backend: httpd-UDS
[Sun Jan 30 12:31:10.794520 2022] [proxy:error] [pid 4428:tid 140683574691584] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:31:10.794594 2022] [proxy_http:error] [pid 4428:tid 140683574691584] [client 190.5.41.126:21214] AH01114: HTTP: failed to make connection to backend: httpd-UDS
[Sun Jan 30 12:38:08.054427 2022] [proxy:error] [pid 4428:tid 140683700582144] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:38:08.054546 2022] [proxy_http:error] [pid 4428:tid 140683700582144] [client 190.5.41.126:21390] AH01114: HTTP: failed to make connection to backend: httpd-UDS, referer: https://my.server.com/
[Sun Jan 30 12:38:08.063705 2022] [proxy:error] [pid 4428:tid 140683708974848] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:38:08.063756 2022] [proxy_http:error] [pid 4428:tid 140683708974848] [client 190.5.41.126:20860] AH01114: HTTP: failed to make connection to backend: httpd-UDS, referer: https://my.server.com/
[Sun Jan 30 12:38:08.079125 2022] [proxy:error] [pid 4428:tid 140683583084288] (13)Permission denied: AH02454: HTTP: attempt to connect to Unix domain socket /var/run/apache2/ (localhost) failed
[Sun Jan 30 12:38:08.079181 2022] [proxy_http:error] [pid 4428:tid 140683583084288] [client 190.5.41.126:21570] AH01114: HTTP: failed to make connection to backend: httpd-UDS, referer: https://my.server.com/

Traccar service is running

Anton Tananaev2 years ago

Does it work if you bypass apache?

Claudio Carrasco2 years ago

How can I do that? disabling it?

Anton Tananaev2 years ago

Connect directly to Traccar.

gabriel852 years ago

Maybe obvious, but did you try restarting the server? (if possible)

Anton Tananaev2 years ago

Looks like someone is trying to exploit an old Apache version. Some of our own servers got hit by this problem as well.

You need to upgrade Apache to version 2.4.49 or higher. Check your current version:

apache2 -v

On Ubuntu you can upgrade like this:

sudo add-apt-repository ppa:ondrej/apache2 -y && sudo apt update
sudo apt --only-upgrade install apache2
Sanjay Shah2 years ago

Apache was there in 4.14 ?

as when i ran this apache2 -v it says 'apaceh2' not found

Anton Tananaev2 years ago

If you don't have Apache then you don't have this problem.