Centova Technologies Forum
Centova Cast v3 => Bugs and issues => Topic started by: My Auto DJ on August 30, 2012, 07:50:06 am
-
Not sure what the problems is but this is starting to run very bad, very unstable, your welcome to check the log out if you want Steve but something is not right, had to restart the server -- this seems to be the same problem I had before, the more accounts I put on it the more problems
-
I have similar problem.
My reseller have created new account and after that I'm not able to login to CC panel. I'm getting error
Error
Sorry, an error occurred while attempting to load the requested page.
I think it may be related with cronjob because after creating account i had message that cronjob is running on normal basis but it not able to finish all jobs.
After runnig ccmanage cronjob all I'm getting error that another istance of cronjob is runnig and to try later but whenever I'm trying I'm still getting the same message.
-
This is a bad news to me. I will start to use, but now I will be very afraid in have some issue like that. I hope Steve look at this soon.
-
The streams keep restarting now, I have to start removing accounts I guess, yea this sucks -- I also see the cron job message
SystemControl::cronjob: Another cron job instance is already running
& yes I also get that same error message
Sorry, an error occurred while attempting to load the requested page.
Thanks for joining in on this guys, I at least know I am not alone :)
STEVE I HAVE PM'ed YOU MY ROOT INFO FOR THIS SERVER, FEEL FREE TO ACCESS ANYTIME YOU LIKE
-
Sorry, but while I'm more than happy to help and very interested in resolving any bugs that may exist, this doesn't tell me anything useful as-is -- I need specifics in order to diagnose any issues you're experiencing.
Not sure what the problems is but this is starting to run very bad
Very bad how? What are the symptoms?
very unstable
Very unstable how? What are you experiencing instability with? Is a particular program exiting unexpectedly? If so, which one?
Any server on which Centova Cast is installed has dozens of programs running, some of which are developed by us (most of the ones whose names begin with "cc-") and many of which are not (sc_serv, sc_trans, ices, icecast, all of your system processes, etc.) Without knowing exactly what programs are failing, and specifically HOW they're failing, we can't even begin to assess where the problem lays.
your welcome to check the log out if you want Steve but something is not right, had to restart the server
Why did you have to restart the server? What exact scenario caused you to feel that this was necessary? Symptoms? syslog output?
this seems to be the same problem I had before, the more accounts I put on it the more problems
Are you perhaps overloading your server? Remember that sc_trans v2 has substantially greater resource requirements than ices. And if you're using the new multi-mountpoint features, remember that each individual mount point puts the same load on the CPU that a single stream would have in CCv2.
I'd be happy to take a look at your server but I'd kindly ask that you'd provide at least a bit of info about what exactly is going wrong before I login, otherwise I'm stuck trying to diagnose a problem without even knowing what I'm looking for.
-
The streams keep restarting now
And what do the logs for the streams say when this happens? Check each affected stream's error log and source log for error messages just prior to the most recent restart.
I also see the cron job message
SystemControl::cronjob: Another cron job instance is already running
Is that when you run it manually, or is this being emailed to you every time the cron job runs?
-
I have similar problem.
My reseller have created new account and after that I'm not able to login to CC panel. I'm getting error
Error
Sorry, an error occurred while attempting to load the requested page.
That means nginx is reporting an internal error of some sort. If you get it on every page load, most likely PHP crashed... again, please see what I said previously in this thread about every Centova Cast server running a ton of different software, much of which is not even developed by us. We need specifics in order to track down what application is having problems.
You may find useful error information in:
/usr/local/centovacast/var/log/cc-web.log (the nginx web server log)
/usr/local/centovacast/var/log/cc-appserver.log (the php log)
/usr/local/centovacast/var/log/cc-fpm.log (the php fastcgi process manager log)
I think it may be related with cronjob because after creating account i had message that cronjob is running on normal basis but it not able to finish all jobs.
After runnig ccmanage cronjob all I'm getting error that another istance of cronjob is runnig and to try later but whenever I'm trying I'm still getting the same message.
Explained here (https://secure.centova.com/pages/faqs/display/diagnosing_cron_job_problems_113). The article refers to v2.2.x but v3.x is mostly identical for the purposes of the article, with the exception that it's in /usr/local/centovacast/system/ instead of /home/centovacast/system/.
-
I do not think I am overloading my server there are only 7 accounts on it I use the same providers/servers with all my Centova accounts, I have not modified anything others are also having this same problem with same symptons, I got the error...
Sorry, an error occurred while attempting to load the requested page.
SO I just reboot the server using Putty, I have no choice the streams stop and I have no option in browser, I thought it could be APACHE issue but the streams also go down -- I have no clue what cause it, seems to be random and when I run and watch TOP command I do not see anything that is running at a high load or high RAM - I also I get 7 emails 1 for each account few times a day saying the server restarted.
I have 6 SHOUTcast and 1 Icecast server running, my load stays @ under 1.0, it's 0.19 now, RAM 286/1128MB
Dedicated CPU 3.6GHz
Dedicated RAM 1128MB
-
Remember that sc_trans v2 has substantially greater resource requirements than ices.
Do you mean how much % sc_trans v2 is more heavy than ices?
-
Command: # /usr/local/centovacast/bin/ccmanage cronjob all
[INF] WARNING: A previous cron job instance appears to be hung; killing it and proceeding.
PHP Fatal error: Call to undefined function posix_kill() in /usr/local/centovacast/system/class_SystemControl.php on line 663
Fatal error: Call to undefined function posix_kill() in /usr/local/centovacast/system/class_SystemControl.php on line 663
Command: # /usr/local/centovacast/system/runascc/runascc exec ccmanage cronjob all --debug
bash: /usr/local/centovacast/system/runascc/runascc: No such file or directory
crontab logs showing that Centova cast cron running on proper time (period)
/usr/local/centovacast/var/log/cc-web.log (the nginx web server log)
Latest log is empty because i have cleaned that and actually everytnig is running until new account is created.
Previous log:
2012/08/30 21:36:40 [error] 21771#0: *419 open() "/usr/local/centovacast/web/robots.txt" failed (2: No such file or directory), client: xx.xx.xx.xx, server: centovacast, request: "GET /robots.txt HTTP/1.1", host: "domain.com:2199"
2012/08/30 22:02:10 [error] 21771#0: *2008 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 127.0.0.1, server: centovacast, request: "POST /api.php HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "localhost:2199"
2012/08/30 22:02:20 [error] 21771#0: *2015 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 127.0.0.1, server: centovacast, request: "POST /api.php HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "localhost:2199"
2012/08/30 22:08:08 [error] 6632#0: *193 upstream timed out (110: Connection timed out) while reading response header from upstream, client: xx.xx.xx.xx, server: centovacast, request: "GET /client/index.php HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "domain.com:2199", referrer: "https://domain.com:2199/admin/index.php?page=accounts"
2012/08/30 22:09:14 [error] 6632#0: *251 upstream timed out (110: Connection timed out) while reading response header from upstream, client: xx.xx.xx.xx, server: centovacast, request: "GET /admin/index.php?page=accounts&action=edit&username=rtpdc HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "domain.com:2199", referrer: "https://domain.com:2199/admin/index.php?page=accounts"
/usr/local/centovacast/var/log/cc-appserver.log (the php log)
1-Aug-2012 02:15:01] NOTICE: error log file re-opened
[31-Aug-2012 02:15:01] NOTICE: Reloading in progress ...
[31-Aug-2012 02:15:01] NOTICE: reloading: execvp("/usr/local/centovacast/sbin/cc-appserver", {"/usr/local/centovacast/sbin/cc-appserver", "--fpm-config", "/usr/local/centovacast/etc/cc-appserver.conf", "-c", "/usr/local/centovacast/etc/cc-system.conf"})
[31-Aug-2012 02:15:01] NOTICE: using inherited socket fd=6, "/usr/local/centovacast/var/run/cc-appserver.sock"
[31-Aug-2012 02:15:01] NOTICE: using inherited socket fd=6, "/usr/local/centovacast/var/run/cc-appserver.sock"
[31-Aug-2012 02:15:01] NOTICE: fpm is running, pid 30590
[31-Aug-2012 02:15:01] NOTICE: ready to handle connections
[31-Aug-2012 03:05:02] NOTICE: [pool webintf] child 30593 exited with code 0 after 3000.362661 seconds from start
[31-Aug-2012 03:05:02] NOTICE: [pool webintf] child 3236 started
[31-Aug-2012 03:05:02] NOTICE: [pool webintf] child 30594 exited with code 0 after 3000.499530 seconds from start
[31-Aug-2012 03:05:02] NOTICE: [pool webintf] child 3240 started
[31-Aug-2012 03:15:19] NOTICE: [pool webintf] child 3840 exited with code 0 after 304.627240 seconds from start
[31-Aug-2012 03:15:19] NOTICE: [pool webintf] child 4739 started
[31-Aug-2012 03:18:20] NOTICE: [pool webintf] child 4275 exited with code 0 after 305.397847 seconds from start
[31-Aug-2012 03:18:20] NOTICE: [pool webintf] child 5439 started
[31-Aug-2012 03:54:01] NOTICE: [pool webintf] child 4739 exited with code 0 after 2322.246555 seconds from start
[31-Aug-2012 03:54:01] NOTICE: [pool webintf] child 12115 started
[31-Aug-2012 03:57:02] NOTICE: [pool webintf] child 4870 exited with code 0 after 2447.081820 seconds from start
[31-Aug-2012 03:57:02] NOTICE: [pool webintf] child 12414 started
[31-Aug-2012 04:36:01] NOTICE: [pool webintf] child 13061 exited with code 0 after 2029.776826 seconds from start
[31-Aug-2012 04:36:01] NOTICE: [pool webintf] child 16532 started
[31-Aug-2012 05:10:01] NOTICE: [pool webintf] child 13687 exited with code 0 after 3756.667036 seconds from start
[31-Aug-2012 05:10:01] NOTICE: [pool webintf] child 19355 started
[31-Aug-2012 05:13:27] NOTICE: [pool webintf] child 13711 exited with code 0 after 3961.464131 seconds from start
[31-Aug-2012 05:13:27] NOTICE: [pool webintf] child 19567 started
[31-Aug-2012 05:35:02] NOTICE: [pool webintf] child 16532 exited with code 0 after 3540.410655 seconds from start
[31-Aug-2012 05:35:02] NOTICE: [pool webintf] child 22237 started
[31-Aug-2012 06:00:33] NOTICE: [pool webintf] child 24122 exited with code 0 after 300.005363 seconds from start
[31-Aug-2012 06:00:33] NOTICE: [pool webintf] child 24883 started
[31-Aug-2012 06:57:02] NOTICE: [pool webintf] child 24889 exited with code 0 after 3389.124869 seconds from start
[31-Aug-2012 06:57:02] NOTICE: [pool webintf] child 29691 started
[31-Aug-2012 06:58:02] NOTICE: [pool webintf] child 24883 exited with code 0 after 3448.750730 seconds from start
[31-Aug-2012 06:58:02] NOTICE: [pool webintf] child 29781 started
[31-Aug-2012 07:13:01] NOTICE: [pool webintf] child 25145 exited with code 0 after 4288.272378 seconds from start
[31-Aug-2012 07:13:01] NOTICE: [pool webintf] child 31133 started
[31-Aug-2012 08:12:01] NOTICE: [pool webintf] child 29691 exited with code 0 after 4499.169263 seconds from start
[31-Aug-2012 08:12:01] NOTICE: [pool webintf] child 5091 started
[31-Aug-2012 08:13:02] NOTICE: [pool webintf] child 29781 exited with code 0 after 4500.215255 seconds from start
[31-Aug-2012 08:13:02] NOTICE: [pool webintf] child 5233 started
[31-Aug-2012 08:28:01] NOTICE: [pool webintf] child 31133 exited with code 0 after 4499.921555 seconds from start
[31-Aug-2012 08:28:01] NOTICE: [pool webintf] child 7147 started
[31-Aug-2012 08:59:22] NOTICE: [pool webintf] child 11462 exited with code 0 after 414.067834 seconds from start
[31-Aug-2012 08:59:22] NOTICE: [pool webintf] child 12599 started
[31-Aug-2012 09:00:21] NOTICE: [pool webintf] child 11602 exited with code 0 after 417.420762 seconds from start
[31-Aug-2012 09:00:21] NOTICE: [pool webintf] child 12801 started
[31-Aug-2012 09:36:02] NOTICE: [pool webintf] child 12599 exited with code 0 after 2200.025139 seconds from start
[31-Aug-2012 09:36:02] NOTICE: [pool webintf] child 17555 started
[31-Aug-2012 09:41:02] NOTICE: [pool webintf] child 12801 exited with code 0 after 2440.415115 seconds from start
[31-Aug-2012 09:41:02] NOTICE: [pool webintf] child 18252 started
[31-Aug-2012 09:42:01] NOTICE: [pool webintf] child 12792 exited with code 0 after 2499.862403 seconds from start
[31-Aug-2012 09:42:01] NOTICE: [pool webintf] child 18358 started
[31-Aug-2012 10:28:06] NOTICE: [pool webintf] child 23872 exited with code 0 after 824.339549 seconds from start
[31-Aug-2012 10:28:06] NOTICE: [pool webintf] child 26885 started
[31-Aug-2012 11:09:16] NOTICE: [pool webintf] child 28227 exited with code 0 after 2172.463402 seconds from start
[31-Aug-2012 11:09:16] NOTICE: [pool webintf] child 5715 started
[31-Aug-2012 11:10:16] NOTICE: [pool webintf] child 28483 exited with code 0 after 2172.049416 seconds from start
[31-Aug-2012 11:10:16] NOTICE: [pool webintf] child 6096 started
[31-Aug-2012 11:12:01] NOTICE: [pool webintf] child 30705 exited with code 0 after 1694.043204 seconds from start
[31-Aug-2012 11:12:01] NOTICE: [pool webintf] child 6603 started
[31-Aug-2012 11:15:16] NOTICE: [pool webintf] child 6096 exited with code 0 after 300.282015 seconds from start
[31-Aug-2012 11:15:16] NOTICE: [pool webintf] child 7740 started
[31-Aug-2012 11:38:04] NOTICE: [pool webintf] child 8510 exited with code 0 after 1188.211837 seconds from start
[31-Aug-2012 11:38:04] NOTICE: [pool webintf] child 13423 started
[31-Aug-2012 12:03:26] NOTICE: [pool webintf] child 16136 exited with code 0 after 1042.011375 seconds from start
[31-Aug-2012 12:03:26] NOTICE: [pool webintf] child 20899 started
[31-Aug-2012 12:23:56] NOTICE: [pool webintf] child 25640 exited with code 0 after 303.121238 seconds from start
[31-Aug-2012 12:23:56] NOTICE: [pool webintf] child 27238 started
[31-Aug-2012 12:25:31] NOTICE: [pool webintf] child 25924 exited with code 0 after 337.931834 seconds from start
[31-Aug-2012 12:25:31] NOTICE: [pool webintf] child 27742 started
[31-Aug-2012 12:27:54] NOTICE: [pool webintf] child 26911 exited with code 0 after 300.655788 seconds from start
[31-Aug-2012 12:27:54] NOTICE: [pool webintf] child 28609 started
[31-Aug-2012 12:40:02] NOTICE: [pool webintf] child 27238 exited with code 0 after 965.628003 seconds from start
[31-Aug-2012 12:40:02] NOTICE: [pool webintf] child 728 started
[31-Aug-2012 12:54:01] NOTICE: [pool webintf] child 27742 exited with code 0 after 1710.521831 seconds from start
[31-Aug-2012 12:54:01] NOTICE: [pool webintf] child 4968 started
[31-Aug-2012 13:31:00] NOTICE: [pool webintf] child 28609 exited with code 0 after 3786.662781 seconds from start
[31-Aug-2012 13:31:00] NOTICE: [pool webintf] child 13920 started
[31-Aug-2012 13:32:01] NOTICE: [pool webintf] child 728 exited with code 0 after 3119.041927 seconds from start
[31-Aug-2012 13:32:01] NOTICE: [pool webintf] child 14205 started
[31-Aug-2012 13:32:59] NOTICE: [pool webintf] child 4968 exited with code 0 after 2337.968758 seconds from start
[31-Aug-2012 13:32:59] NOTICE: [pool webintf] child 14491 started
[31-Aug-2012 13:36:57] NOTICE: [pool webintf] child 14205 exited with code 0 after 296.525960 seconds from start
[31-Aug-2012 13:36:57] NOTICE: [pool webintf] child 15628 started
[31-Aug-2012 13:37:02] NOTICE: [pool webintf] child 14478 exited with code 0 after 244.149165 seconds from start
[31-Aug-2012 13:37:02] NOTICE: [pool webintf] child 15724 started
[31-Aug-2012 13:37:06] NOTICE: [pool webintf] child 14491 exited with code 0 after 246.147133 seconds from start
[31-Aug-2012 13:37:06] NOTICE: [pool webintf] child 15747 started
[31-Aug-2012 14:29:02] NOTICE: [pool webintf] child 15747 exited with code 0 after 3116.172850 seconds from start
[31-Aug-2012 14:29:02] NOTICE: [pool webintf] child 26145 started
[31-Aug-2012 14:34:02] NOTICE: [pool webintf] child 15898 exited with code 0 after 3363.260544 seconds from start
[31-Aug-2012 14:34:02] NOTICE: [pool webintf] child 26910 started
[31-Aug-2012 14:52:02] NOTICE: [pool webintf] child 16119 exited with code 0 after 4381.340688 seconds from start
[31-Aug-2012 14:52:02] NOTICE: [pool webintf] child 29265 started
[31-Aug-2012 15:33:24] NOTICE: [pool webintf] child 32038 exited with code 0 after 1456.157691 seconds from start
[31-Aug-2012 15:33:24] NOTICE: [pool webintf] child 4244 started
[31-Aug-2012 15:49:02] NOTICE: [pool webintf] child 32405 exited with code 0 after 2273.752109 seconds from start
[31-Aug-2012 15:49:02] NOTICE: [pool webintf] child 7534 started
[31-Aug-2012 16:46:25] NOTICE: [pool webintf] child 11284 exited with code 0 after 2527.916809 seconds from start
[31-Aug-2012 16:46:25] NOTICE: [pool webintf] child 20413 started
[31-Aug-2012 17:53:01] NOTICE: [pool webintf] child 25503 exited with code 0 after 2358.672874 seconds from start
[31-Aug-2012 17:53:01] NOTICE: [pool webintf] child 32734 started
[31-Aug-2012 18:06:01] NOTICE: [pool webintf] child 25710 exited with code 0 after 3078.027590 seconds from start
[31-Aug-2012 18:06:01] NOTICE: [pool webintf] child 3318 started
[31-Aug-2012 18:20:02] NOTICE: [pool webintf] child 25992 exited with code 0 after 3858.904277 seconds from start
[31-Aug-2012 18:20:02] NOTICE: [pool webintf] child 7288 started
[31-Aug-2012 18:37:28] NOTICE: [pool webintf] child 7288 exited with code 0 after 1045.774161 seconds from start
[31-Aug-2012 18:37:28] NOTICE: [pool webintf] child 12273 started
[31-Aug-2012 18:37:39] NOTICE: [pool webintf] child 7636 exited with code 0 after 982.096335 seconds from start
[31-Aug-2012 18:37:39] NOTICE: [pool webintf] child 12317 started
[31-Aug-2012 18:52:15] NOTICE: [pool webintf] child 16080 exited with code 0 after 162.886070 seconds from start
[31-Aug-2012 18:52:15] NOTICE: [pool webintf] child 17279 started
[31-Aug-2012 18:52:26] NOTICE: [pool webintf] child 16207 exited with code 0 after 153.368147 seconds from start
[31-Aug-2012 18:52:26] NOTICE: [pool webintf] child 17358 started
[31-Aug-2012 19:00:23] NOTICE: [pool webintf] child 20144 exited with code 0 after 120.196653 seconds from start
[31-Aug-2012 19:00:23] NOTICE: [pool webintf] child 21198 started
[31-Aug-2012 19:40:32] NOTICE: [pool webintf] child 1921 exited with code 0 after 634.779895 seconds from start
[31-Aug-2012 19:40:32] NOTICE: [pool webintf] child 7015 started
[31-Aug-2012 20:00:58] NOTICE: [pool webintf] child 12086 exited with code 0 after 685.412395 seconds from start
[31-Aug-2012 20:00:58] NOTICE: [pool webintf] child 18177 started
[31-Aug-2012 20:21:02] NOTICE: [pool webintf] child 27883 exited with code 0 after 168.118986 seconds from start
[31-Aug-2012 20:21:02] NOTICE: [pool webintf] child 29473 started
[31-Aug-2012 20:22:01] NOTICE: [pool webintf] child 28384 exited with code 0 after 167.391371 seconds from start
[31-Aug-2012 20:22:01] NOTICE: [pool webintf] child 30041 started
[31-Aug-2012 20:23:23] NOTICE: [pool webintf] child 29473 exited with code 0 after 141.651644 seconds from start
[31-Aug-2012 20:23:23] NOTICE: [pool webintf] child 30871 started
[31-Aug-2012 20:23:23] NOTICE: [pool webintf] child 29570 exited with code 0 after 129.798444 seconds from start
[31-Aug-2012 20:23:23] NOTICE: [pool webintf] child 30877 started
[31-Aug-2012 20:24:22] NOTICE: [pool webintf] child 30041 exited with code 0 after 140.982965 seconds from start
[31-Aug-2012 20:24:22] NOTICE: [pool webintf] child 31373 started
[31-Aug-2012 20:31:46] NOTICE: [pool webintf] child 32595 exited with code 0 after 315.795367 seconds from start
[31-Aug-2012 20:31:46] NOTICE: [pool webintf] child 2811 started
[31-Aug-2012 20:32:29] NOTICE: [pool webintf] child 560 exited with code 0 after 300.558272 seconds from start
[31-Aug-2012 20:32:29] NOTICE: [pool webintf] child 3264 started
[31-Aug-2012 20:33:29] NOTICE: [pool webintf] child 1100 exited with code 0 after 300.700314 seconds from start
[31-Aug-2012 20:33:29] NOTICE: [pool webintf] child 3813 started
[31-Aug-2012 20:46:01] NOTICE: [pool webintf] child 3813 exited with code 0 after 751.668415 seconds from start
[31-Aug-2012 20:46:01] NOTICE: [pool webintf] child 10197 started
[31-Aug-2012 20:46:16] NOTICE: [pool webintf] child 3827 exited with code 0 after 766.503553 seconds from start
[31-Aug-2012 20:46:16] NOTICE: [pool webintf] child 10317 started
[31-Aug-2012 21:20:02] NOTICE: [pool webintf] child 20650 exited with code 0 after 744.322113 seconds from start
[31-Aug-2012 21:20:02] NOTICE: [pool webintf] child 25348 started
[31-Aug-2012 21:28:13] NOTICE: [pool webintf] child 26832 exited with code 0 after 240.587942 seconds from start
[31-Aug-2012 21:28:13] NOTICE: [pool webintf] child 28487 started
[31-Aug-2012 21:29:13] NOTICE: [pool webintf] child 27308 exited with code 0 after 240.401269 seconds from start
[31-Aug-2012 21:29:13] NOTICE: [pool webintf] child 28831 started
[31-Aug-2012 21:30:13] NOTICE: [pool webintf] child 27692 exited with code 0 after 240.312694 seconds from start
[31-Aug-2012 21:30:13] NOTICE: [pool webintf] child 29282 started
-
/usr/local/centovacast/var/log/cc-fpm.log (the php fastcgi process manager log)
There is no cc-fpm.log file ....
appsrv-webintf-slow.log
[30-Aug-2012 22:02:22] [pool webintf] pid 3277
script_filename = /usr/local/centovacast/web/api.php
[0x00007f4942f08cf0] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
[0x00007f4942f07eb8] _get_status_quickxml() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:452
[0x00007f4942f05508] get_status() /usr/local/centovacast/system/class_ServerControl.php:488
[0x00007f4942f04da8] api_getstatus() /usr/local/centovacast/system/class_ServerControl.php:278
[0x00007fff7d6188d0] __call() unknown:0
[0x00007fff7d618bb0] getstatus() unknown:0
[0x00007f4942f01fd8] call_user_func_array() /usr/local/centovacast/web/api.php:315
[30-Aug-2012 22:02:22] [pool webintf] pid 3766
script_filename = /usr/local/centovacast/web/api.php
[0x00007f4942f08cf0] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
[0x00007f4942f07eb8] _get_status_quickxml() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:452
[0x00007f4942f05508] get_status() /usr/local/centovacast/system/class_ServerControl.php:488
[0x00007f4942f04da8] api_getstatus() /usr/local/centovacast/system/class_ServerControl.php:278
[0x00007fff7d6188d0] __call() unknown:0
[0x00007fff7d618bb0] getstatus() unknown:0
[0x00007f4942f01fd8] call_user_func_array() /usr/local/centovacast/web/api.php:315
[30-Aug-2012 22:02:22] [pool webintf] pid 4330
script_filename = /usr/local/centovacast/web/reseller/rpc.php
[0x00007f4942f0c9e8] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
[0x00007f4942f0bbb0] _get_status_quickxml() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:452
[0x00007f4942f09200] get_status() /usr/local/centovacast/system/class_ServerControl.php:488
[0x00007f4942f08aa0] api_getstatus() /usr/local/centovacast/system/class_ServerControl.php:278
[0x00007fff7d6185d0] __call() unknown:0
[0x00007f4942f06ad0] getstatus() /usr/local/centovacast/web/admin/rpc/class_RPCstreaminfo.php:41
[0x00007f4942f06710] _get_stream_info() /usr/local/centovacast/web/admin/rpc/class_RPCstreaminfo.php:108
[0x00007fff7d618a30] api_get_by_username() unknown:0
[0x00007f4942f05988] call_user_func_array() /usr/local/centovacast/web//rpc/class_RPCServer.php:192
[0x00007f4942f03028] execute() /usr/local/centovacast/web/class_RPCApplication.php:324
[0x00007f4942f02bd0] execute() /usr/local/centovacast/web/reseller/rpc.php:19
[30-Aug-2012 22:02:22] [pool webintf] pid 4755
script_filename = /usr/local/centovacast/web/reseller/index.php
[0x00007f4942f03c38] session_start() /usr/local/centovacast/system/class_UserSession.php:351
[0x00007f4942f035d8] __construct() /usr/local/centovacast/web/class_WebApplication.php:130
[0x00007f4942f034a0] initialize() /usr/local/centovacast/web/reseller/class_ResellerApplication.php:38
[0x00007f4942f02c08] initialize() /usr/local/centovacast/web/reseller/index.php:48
[30-Aug-2012 22:04:21] [pool webintf] pid 5869
script_filename = /usr/local/centovacast/web/admin/rpc.php
[0x00007f34c1a7da38] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
[0x00007f34c1a7cc00] _get_status_quickxml() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:452
[0x00007f34c1a7a250] get_status() /usr/local/centovacast/system/class_ServerControl.php:488
[0x00007f34c1a79af0] api_getstatus() /usr/local/centovacast/system/class_ServerControl.php:278
[0x00007fffec753af0] __call() unknown:0
[0x00007f34c1a77b20] getstatus() /usr/local/centovacast/web/admin//rpc/class_RPCstreaminfo.php:41
[0x00007f34c1a77760] _get_stream_info() /usr/local/centovacast/web/admin//rpc/class_RPCstreaminfo.php:108
[0x00007fffec753f50] api_get_by_username() unknown:0
[0x00007f34c1a769d8] call_user_func_array() /usr/local/centovacast/web//rpc/class_RPCServer.php:192
[0x00007f34c1a74078] execute() /usr/local/centovacast/web/class_RPCApplication.php:324
[0x00007f34c1a73bc0] execute() /usr/local/centovacast/web/admin/rpc.php:20
[30-Aug-2012 22:04:21] [pool webintf] pid 5835
script_filename = /usr/local/centovacast/web/admin/rpc.php
[0x00007f34c1a77760] session_start() /usr/local/centovacast/system/class_UserSession.php:351
[0x00007f34c1a76988] __construct() /usr/local/centovacast/web/class_RPCApplication.php:138
[0x00007f34c1a74078] authorized() /usr/local/centovacast/web/class_RPCApplication.php:306
[0x00007f34c1a73bc0] execute() /usr/local/centovacast/web/admin/rpc.php:20
[30-Aug-2012 22:08:28] [pool webintf] pid 6903
script_filename = /usr/local/centovacast/web/client/index.php
[0x00007fe3205cd628] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
[0x00007fe3205cc7f0] _get_status_quickxml() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:452
[0x00007fe3205c9e40] get_status() /usr/local/centovacast/system/class_ServerControl.php:488
[0x00007fe3205c96e0] api_getstatus() /usr/local/centovacast/system/class_ServerControl.php:278
[0x00007fffe63124c0] __call() unknown:0
[0x00007fe3205c7788] getstatus() /usr/local/centovacast/web/class_StreamStatus.php:123
[0x00007fe3205c6e70] refresh() /usr/local/centovacast/web/class_StreamStatus.php:415
[0x00007fe3205c6418] check() /usr/local/centovacast/web/client/class_ClientApplication.php:62
[0x00007fe3205c5be0] prepare_serverinfo() /usr/local/centovacast/web/client/class_ClientApplication.php:121
[0x00007fffe6312aa0] _hook_pre_module_execute() unknown:0
[0x00007fe3205c5510] call_user_func_array() /usr/local/centovacast/web/class_WebApplication.php:290
[0x00007fe3205c36c0] trigger_hook() /usr/local/centovacast/web/class_WebApplication.php:212
[0x00007fe3205c33f0] execute() /usr/local/centovacast/web/client/class_ClientApplication.php:145
[0x00007fe3205c2b48] execute() /usr/local/centovacast/web/client/index.php:51
[30-Aug-2012 22:09:28] [pool webintf] pid 7976
script_filename = /usr/local/centovacast/web/admin/rpc.php
[0x00007fe3205c6910] session_start() /usr/local/centovacast/system/class_UserSession.php:351
[0x00007fe3205c5b38] __construct() /usr/local/centovacast/web/class_RPCApplication.php:138
[0x00007fe3205c3228] authorized() /usr/local/centovacast/web/class_RPCApplication.php:306
[0x00007fe3205c2d70] execute() /usr/local/centovacast/web/admin/rpc.php:20
[30-Aug-2012 22:09:28] [pool webintf] pid 8506
script_filename = /usr/local/centovacast/web/admin/rpc.php
[0x00007fe3205c6910] session_start() /usr/local/centovacast/system/class_UserSession.php:351
[0x00007fe3205c5b38] __construct() /usr/local/centovacast/web/class_RPCApplication.php:138
[0x00007fe3205c3228] authorized() /usr/local/centovacast/web/class_RPCApplication.php:306
[0x00007fe3205c2d70] execute() /usr/local/centovacast/web/admin/rpc.php:20
[30-Aug-2012 22:09:28] [pool webintf] pid 8549
script_filename = /usr/local/centovacast/web/admin/index.php
[0x00007fe3205c3bd8] session_start() /usr/local/centovacast/system/class_UserSession.php:351
[0x00007fe3205c3578] __construct() /usr/local/centovacast/web/class_WebApplication.php:130
[0x00007fe3205c3440] initialize() /usr/local/centovacast/web/admin/class_AdminApplication.php:38
[0x00007fe3205c2ba8] initialize() /usr/local/centovacast/web/admin/index.php:48
-
I also want to add, the problems start almost instantly after creating the account(s), mp3's have not even been uploaded and the server has not started, this does not seem to have anything to do with the server, I have, more or less, the same error logs as HEADSHAKER listed above, as if something is being written to the sc_serve or sc_trans file that it does not like.
-
Just to make clear i will explain You what I'm doing:
1. Creating Fresh account (sc_serv2, sc_trans2)
2. Try to login in to account by admin panel (and then is error), after that any page of centovacastnot working. (try to login to new account with its details not working too)
3. Cleaning session files (/usr/local/centovacast/var/lib/sessions) helps. I can log in to admin page
4. Trying once more login in to user account (see point 2 ) ;P
5. Deleting previously created account. Getting error message
Processing account test ...
Invalid JSON: =============================================================================== Error: Could not execute query File: /usr/local/centovacast/system/class_AccountControl.php:334 Query: DELETE FROM wmssettings WHERE accountid=148 Reason: Unknown column 'accountid' in 'where clause' Call: $SQL->misc_query() =============================================================================== {"type":"success","response":{"data":null,"message":"Account removed"}}
-
Hmm wierd.
After creating account is like that:
Until I will not login in to freshly created account everything is ok.
After logging to fresh account panel website stop working. Just cleraring session files helps.
I found that if i will create account and i will change account port number from admin area I'm able to login to account normally ...
-
Yes mine did that too, exactly as you described Headshaker, but now it just seems to get worse and worse, Steve please can you login and check you have my root p/w and permission to do whatever you like... Headshaker is having the same issues I do not see how it can be a server issue + I only have 7 accounts, and now the load is slowly getting higher and higher each day, there is something seriously wrong and each day that passes it costs me (us) more and more money, I am not really able to trouble shoot it as I can't even figure out what causes it, but the fact another user is also having the exact same issues would indicate to me it's a script or compatability issue, an encoded script at that so I couldn't even correct the issue if I wanted to. You would not believe the amount of searches I get for Centovav3, Steve I really could use a early Christmas gift this year, I beg you please can you help us out your soooo close to completing this.
-
What OS do you have ?? I cant even get my install to create accounts
-
Messages from command: # /usr/local/centovacast/bin/ccmanage cronjob all
[INF] Cron job startup at 2012-09-02 10:22:56
[INF] Checking for crashed servers...
[INF] Log rotation frequency is 12, log process frequency is 12, last processed 2012-09-01 22:10:02, last rotated 2012-09-01 22:10:02, currently 2012-09-02 10:22:57, needsrotate, needsprocess
[INF] Processing logs...
[INF] Account maxitalo is not a streaming server account
[INF] Account radiotp is not a streaming server account
[INF] Processing logs for rmi1 ...
[INF] Disk usage: 12513
[INF] Processing logs for rmi2 ...
[INF] Disk usage: 4036
[INF] Processing logs for rmi3 ...
[INF] Disk usage: 8524
[INF] Processing logs for rmi4 ...
PHP Warning: gmmktime() expects parameter 6 to be long, string given in /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php on line 285
Warning: gmmktime() expects parameter 6 to be long, string given in /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php on line 285
[INF] Disk usage: 3561
[INF] Processing logs for rmi5 ...
[INF] Disk usage: 4646
[INF] Processing logs for rmi6 ...
[INF] Disk usage: 3630
[INF] Processing logs for rmi7 ...
[INF] Disk usage: 5567
[INF] Processing logs for rmi8 ...
[INF] Disk usage: 2824
[INF] Processing logs for rtpcm ...
[INF] Disk usage: 3085
[INF] Processing logs for rtpdc ...
[INF] Disk usage: 0
[INF] Processing logs for rtphg ...
[INF] Disk usage: 5135
[INF] Updating reseller totals ...
[INF] Account maxitalo is not a streaming server account
[INF] Account radiotp is not a streaming server account
[INF] Optimizing tables...
[INF] Performing hourly maintenance...
Result: ERROR
Command: # /usr/local/centovacast/bin/ccmanage cronjob all --debug
[DBG] Attempting to set user context to all
[INF] Cron job startup at 2012-09-02 10:26:02
[INF] Checking for crashed servers...
[DBG] Begin account check
[DBG] Processing rmi1
[DBG] Checking server process for rmi1 (expected: up)
[DBG] Checking PID 2863
[DBG] 2863 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi1 (expected: up)
[DBG] Checking PID 4884
[DBG] 4884 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi1 is broadcasting at 128
[DBG] Processing rmi2
[DBG] Checking server process for rmi2 (expected: up)
[DBG] Checking PID 2881
[DBG] 2881 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi2 (expected: up)
[DBG] Checking PID 4905
[DBG] 4905 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi2 is broadcasting at 128
[DBG] Processing rmi3
[DBG] Checking server process for rmi3 (expected: up)
[DBG] Checking PID 2917
[DBG] 2917 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi3 (expected: up)
[DBG] Checking PID 4926
[DBG] 4926 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi3 is broadcasting at 128
[DBG] Processing rmi4
[DBG] Checking server process for rmi4 (expected: up)
[DBG] Checking PID 2945
[DBG] 2945 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi4 (expected: up)
[DBG] Checking PID 4949
[DBG] 4949 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi4 is broadcasting at 128
[DBG] Processing rmi5
[DBG] Checking server process for rmi5 (expected: up)
[DBG] Checking PID 2962
[DBG] 2962 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi5 (expected: up)
[DBG] Checking PID 4970
[DBG] 4970 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi5 is broadcasting at 128
[DBG] Processing rmi6
[DBG] Checking server process for rmi6 (expected: up)
[DBG] Checking PID 2979
[DBG] 2979 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi6 (expected: up)
[DBG] Checking PID 5007
[DBG] 5007 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi6 is broadcasting at 128
[DBG] Processing rmi7
[DBG] Checking server process for rmi7 (expected: up)
[DBG] Checking PID 2996
[DBG] 2996 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi7 (expected: up)
[DBG] Checking PID 5027
[DBG] 5027 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi7 is broadcasting at 128
[DBG] Processing rmi8
[DBG] Checking server process for rmi8 (expected: up)
[DBG] Checking PID 3011
[DBG] 3011 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rmi8 (expected: up)
[DBG] Checking PID 5047
[DBG] 5047 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rmi8 is broadcasting at 128
[DBG] Processing rtpcm
[DBG] Checking server process for rtpcm (expected: up)
[DBG] Checking PID 3089
[DBG] 3089 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rtpcm (expected: down)
[DBG] Checking PID 3108
[DBG] 3108 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rtpcm is broadcasting at 128
[DBG] Processing rtpdc
[DBG] Checking server process for rtpdc (expected: down)
[DBG] No PID: 0
[DBG] Check complete
[DBG] Checking sctrans2 application process for rtpdc (expected: down)
[DBG] No PID: 0
[DBG] Application check complete
[DBG] Done application check
[DBG] rtpdc is broadcasting at 0
[DBG] Processing rtphg
[DBG] Checking server process for rtphg (expected: up)
[DBG] Checking PID 32521
[DBG] 32521 state: -
[DBG] Detected as up
[DBG] Check complete
[DBG] Checking sctrans2 application process for rtphg (expected: down)
[DBG] Checking PID 32537
[DBG] 32537 state: -
[DBG] Detected as up
[DBG] Application check complete
[DBG] Done application check
[DBG] rtphg is broadcasting at 128
[DBG] End account check
[INF] Log rotation frequency is 12, log process frequency is 12, last processed 2012-09-02 10:22:57, last rotated 2012-09-02 10:22:57, currently 2012-09-02 10:26:03
Result: ERROR
-
I do not think I am overloading my server there are only 7 accounts on it I use the same providers/servers with all my Centova accounts, I have not modified anything
With all due respect, I can't help you without information about your issue. My post included a substantial list of questions about your issue, and the only one you responded to was the question about overloading your server.
I'd be happy to diagnose your issue if you can answer the questions in this post (http://forums.centova.com/index.php?topic=1846.msg4622#msg4622). Without that info, I can only guess at what you're experiencing. They weren't random or rhetorical questions -- I really do need that information in order to figure out where the problem lies.
others are also having this same problem with same symptons, I got the error...
The problem here is that you have not listed ANY actual symptoms to date, save for vague statements about instability, so I have no way of knowing what those might be.
-
Command: # /usr/local/centovacast/bin/ccmanage cronjob all
Fatal error: Call to undefined function posix_kill() in /usr/local/centovacast/system/class_SystemControl.php on line 663
Ahh, that makes sense -- thanks for pointing this out.
Basically what's happened is an old cron job has hung for some reason, and due to changes we made for security in v3, it can't kill the old instance. Fixed for the next build. Shouldn't be related to the remainder of the issues you're seeing below though.
Command: # /usr/local/centovacast/system/runascc/runascc exec ccmanage cronjob all --debug
bash: /usr/local/centovacast/system/runascc/runascc: No such file or directory
This utility is named /usr/local/centovacast/bin/ccmanage in v3, which is why it couldn't find it here. Replace all instances of "/home/centovacast/system/runascc/runascc exec ccmanage" in v2 articles with "/usr/local/centovacast/bin/ccmanage" for v3.
2012/08/30 22:08:08 [error] 6632#0: *193 upstream timed out (110: Connection timed out) while reading response header from upstream, client: xx.xx.xx.xx, server: centovacast, request: "GET /client/index.php HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "domain.com:2199", referrer: "https://domain.com:2199/admin/index.php?page=accounts"
Definitely confirms a crash/freeze in PHP.
/usr/local/centovacast/var/log/cc-appserver.log (the php log)
...
[31-Aug-2012 02:15:01] NOTICE: Reloading in progress ...
You need to be referring to the *same* section of the cc-appserver.log as you are cc-web.log. You can see in the cc-web.log snippet above that at 2012/08/30 22:08:08 there was a connection failure. So you need to look in cc-appserver.log for log entries prior to 2012/08/30 22:08:08 which might explain why PHP crashed or hung. As you can see, the snippet of cc-appserver.log you sent is from 31-Aug-2012 which is long after the problem occurred with PHP.
Also note, I'm reading your posts in order and responding as I read them, so if you clarified any of this in subsequent posts, please bear with me. :)
-
/usr/local/centovacast/var/log/cc-fpm.log (the php fastcgi process manager log)
There is no cc-fpm.log file ....
Right, sorry, it's renamed to cc-appserver.log now, which you already quoted from.
[30-Aug-2012 22:02:22] [pool webintf] pid 3277
script_filename = /usr/local/centovacast/web/api.php
[0x00007f4942f08cf0] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
Most of these entries seem to just indicate that your ShoutCast2 server(s) is/are slow to return information about your streams. Seems to be a general performance issue.
-
Just to make clear i will explain You what I'm doing:
Very helpful, thanks..
1. Creating Fresh account (sc_serv2, sc_trans2)
2. Try to login in to account by admin panel (and then is error)
What is the exact error you're getting? Details like this are crucial to diagnosing the problem.
after that any page of centovacastnot working. (try to login to new account with its details not working too)
How is it not working? The error you quoted previously ("Sorry, an error occurred while attempting to load the requested page.") should prevent you from accessing ANY page in Centova Cast, including the login page. The fact that you're able to try to login to new accounts seems to indicate that you're not getting that error on the login page. It's all generated by PHP, so if PHP crashed, you should get that same error on every page.
3. Cleaning session files (/usr/local/centovacast/var/lib/sessions) helps. I can log in to admin page
Again, I think I've not received a critical piece of information here because once PHP crashes, it should be unreachable... deleting session files shouldn't make a difference.
5. Deleting previously created account. Getting error message
Query: DELETE FROM wmssettings WHERE accountid=148
Reason: Unknown column 'accountid' in 'where clause'
It looks like your database hasn't been updated to include the latest changes. There were some problems with previous versions of the upgrader that could be responsible for this.
In any case, this is unrelated to the other issues you're experiencing.
-
Steve please can you login and check you have my root p/w and permission to do whatever you like...
Sure can, I just need to know what I'm looking for per my earlier messages.
Headshaker is having the same issues I do not see how it can be a server issue + I only have 7 accounts
Never suggested that it had to be a server issue -- it's most likely a crash in PHP. We're on the bleeding-edge of PHP releases (because we want to make sure we have all the latest security patches) but that also means that we immediately pick up any bugs introduced into PHP by PHP's developers as well. Could be related to that. I'm almost tempted to downgrade to the PHP v5.3 series.
and now the load is slowly getting higher and higher each day
This sounds completely unrelated to anything Headshaker is telling us. Headshaker is reporting a problem in which PHP is crashing, and has provided a variety of hard evidence and log data confirming this.
If PHP crashes, you should see virtually no load at all, because no requests can be serviced by Centova Cast. The fact that you're seeing a load issue seems to indicate that your issue is totally unrelated to Headshaker's.
That's not to say that there couldn't be two separate issues at play here -- that's quite possible -- I just mean to say that, while you've been insisting that your issue is identical to Headshaker's, that doesn't seem to be the case, and as such I can't use any of the information that Headshaker has provided to diagnose your issue.
-
Messages from command: # /usr/local/centovacast/bin/ccmanage cronjob all
All looks good.
[INF] Processing logs for rmi4 ...
PHP Warning: gmmktime() expects parameter 6 to be long, string given in /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php on line 285
This just means that some bad data was encountered in the ShoutCast2 logs for the 'rmi4' account... most likely the rmi4 ShoutCast2 logs got corrupted somehow. Not a problem in itself.
Command: # /usr/local/centovacast/bin/ccmanage cronjob all --debug
This also looks fine.
Based on what you've provided (thanks so much for providing so much detail, btw -- very helpful!), it just looks like PHP is crashing periodically, although I would like to know more about the other errors you were experiencing upon login which I asked about in my last message.
The cron job and other issues you reported appear to be unrelated, but I do appreciate you reporting them so we can deal with those separately for the next build.
BTW, what Linux distro and version eg: (CentOS 6, Debian Squeeze, etc.) and architecture (eg: i686, amd64, etc.) are you using? Perhaps that has something to do with it. Our staff and I are running a handful of production stations on Centova Cast v3 servers and we've encountered no troubles at all on those machines, although they're all Debian Squeeze 64bit servers... I wonder if perhaps there are issues on other platforms.
-
With all due respect, I can't help you without information about your issue. My post included a substantial list of questions about your issue, and the only one you responded to was the question about overloading your server.
Im sorry Steve but I indicated my symptoms were the exact same as Headshaker so I did not think I needed to re-paste the same things (error logs, how to reproduce, etc), I gave you my root p/w, I figured you would want to check for yourself, the fact at least 2 people having the exact same problem would indicate to me there is a bug. The high load only happens right after I add another account, instantly after I create it, I don't even have to start the server everything stops responding. If it were me I would think either a password or port # or something is being written to the sc_serve that conflicts with something, and since I have live clients on it I really don't want to have the server down which is why I had hoped you would go in my Centova v3 and create a account, reproducing the problem yourself would help you figure out the issue a lot better than I can explain.
Sorry, an error occurred while attempting to load the requested page
This is what I meant by high server load, instantly after creating a new account, the page would try to load for several minutes, then come up with a blank white page and that error -- I remove the new account and instantly things return to normal
-
Ok then.
Once again:
My OS is CentOS 6 with Parallels Plesk Panel 10 (64-bit)
Processor- AMD Quad-Core
Speed- 4 Cores x 2.1 GHz
RAM- 4 GB DDR2
RAID Software RAID 1
1. Create new accont (sc_serv 2, sc_trans 2)
2. Try to login to account from admin area with result:
Error
Sorry, an error occurred while attempting to load the requested page.
3. Try to go to https://domain.com:2199/admin/ is giving error above ( the same with any centovacast panel page)
4. Delete sessions files from /usr/local/centovacast/var/lib/sessions
5. Any page redirecting me to login page (logging in, admin area works, another attempt to login to new account go to point 2.)
6. Delete sessions files from /usr/local/centovacast/var/lib/sessions
7. Change new account port number in admin area (port+20)
8. Able to login by admin area and directly by new accont details, no further problems with logging in.
LOGS:
cc-appserver.log
[09-Sep-2012 09:50:52] WARNING: [pool webintf] child 15470, script '/usr/local/centovacast/web/admin/rpc.php' (request: "POST /admin/rpc.php") executing too slow (63.260744 sec), logging
[09-Sep-2012 09:50:52] WARNING: [pool webintf] child 14795, script '/usr/local/centovacast/web/admin/index.php' (request: "GET /admin/index.php") executing too slow (63.170433 sec), logging
[09-Sep-2012 09:50:52] NOTICE: child 14795 stopped for tracing
[09-Sep-2012 09:50:52] NOTICE: about to trace 14795
[09-Sep-2012 09:50:52] NOTICE: finished trace of 14795
[09-Sep-2012 09:50:52] NOTICE: child 15470 stopped for tracing
[09-Sep-2012 09:50:52] NOTICE: about to trace 15470
[09-Sep-2012 09:50:52] NOTICE: finished trace of 15470
[09-Sep-2012 09:52:12] WARNING: [pool webintf] child 15854, script '/usr/local/centovacast/web/admin/rpc.php' (request: "POST /admin/rpc.php") executing too slow (69.800094 sec), logging
[09-Sep-2012 09:52:12] WARNING: [pool webintf] child 15576, script '/usr/local/centovacast/web/jsonapi.php' (request: "GET /jsonapi.php") executing too slow (65.945681 sec), logging
[09-Sep-2012 09:52:12] WARNING: [pool webintf] child 15089, script '/usr/local/centovacast/web/admin/rpc.php' (request: "POST /admin/rpc.php") executing too slow (71.491534 sec), logging
[09-Sep-2012 09:52:12] NOTICE: child 15089 stopped for tracing
[09-Sep-2012 09:52:12] NOTICE: about to trace 15089
[09-Sep-2012 09:52:12] NOTICE: finished trace of 15089
[09-Sep-2012 09:52:12] NOTICE: child 15576 stopped for tracing
[09-Sep-2012 09:52:12] NOTICE: about to trace 15576
[09-Sep-2012 09:52:12] ERROR: failed to ptrace(PEEKDATA) pid 15576: Input/output error (5)
[09-Sep-2012 09:52:12] NOTICE: finished trace of 15576
[09-Sep-2012 09:52:12] NOTICE: child 15854 stopped for tracing
[09-Sep-2012 09:52:12] NOTICE: about to trace 15854
[09-Sep-2012 09:52:12] NOTICE: finished trace of 15854
[09-Sep-2012 09:54:12] WARNING: [pool webintf] child 16268, script '/usr/local/centovacast/web/admin/index.php' (request: "GET /admin/index.php") executing too slow (61.808481 sec), logging
[09-Sep-2012 09:54:12] NOTICE: child 16268 stopped for tracing
[09-Sep-2012 09:54:12] NOTICE: about to trace 16268
[09-Sep-2012 09:54:12] NOTICE: finished trace of 16268
[09-Sep-2012 09:55:52] WARNING: [pool webintf] child 16100, script '/usr/local/centovacast/web/admin/index.php' (request: "GET /admin/index.php") executing too slow (73.751034 sec), logging
[09-Sep-2012 09:55:52] NOTICE: child 16100 stopped for tracing
[09-Sep-2012 09:55:52] NOTICE: about to trace 16100
[09-Sep-2012 09:55:52] NOTICE: finished trace of 16100
[09-Sep-2012 09:57:07] NOTICE: [pool webintf] child 16127 exited with code 0 after 360.917261 seconds from start
[09-Sep-2012 09:57:07] NOTICE: [pool webintf] child 18232 started
cc-web.log
2012/09/09 05:35:35 [error] 29060#0: *8211 open() "/usr/local/centovacast/web/robots.txt" failed (2: No such file or directory), client: 66.219.58.42, server: centovacast, request: "GET /robots.txt HTTP/1.1", host: "newairhost.com:2199"
2012/09/09 09:50:48 [error] 2109#0: *2880 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 82.28.125.167, server: centovacast, request: "POST /admin/rpc.php?m=streaminfo.get_by_username&r=1&r1=91619&s=acctlist&h=0&j=1 HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "newairhost.com:2199", referrer: "https://newairhost.com:2199/admin/index.php?page=accounts"
2012/09/09 09:50:48 [error] 2109#0: *2938 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 82.28.125.167, server: centovacast, request: "GET /admin/index.php?page=accounts&action=setuid&username=hgdfgfhghfd HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "newairhost.com:2199", referrer: "https://newairhost.com:2199/admin/index.php?page=accounts"
2012/09/09 09:52:00 [error] 2109#0: *3017 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 82.28.125.167, server: centovacast, request: "POST /admin/rpc.php?m=streaminfo.get_by_username&r=1&r1=616448&s=acctlist&h=0&j=1 HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "newairhost.com:2199", referrer: "https://newairhost.com:2199/admin/index.php?page=accounts"
2012/09/09 09:52:02 [error] 2109#0: *3018 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 82.28.125.167, server: centovacast, request: "POST /admin/rpc.php?m=streaminfo.get_by_username&r=2&r1=732715&s=acctlist&h=0&j=1 HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "newairhost.com:2199", referrer: "https://newairhost.com:2199/admin/index.php?page=accounts"
2012/09/09 09:52:06 [error] 2109#0: *3019 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 82.28.125.167, server: centovacast, request: "GET /jsonapi.php?m=system.terminate&a%5Busername%5D=hgdfgfhghfd HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "newairhost.com:2199", referrer: "https://newairhost.com:2199/admin/index.php?page=accounts"
2012/09/09 09:54:10 [error] 2109#0: *3252 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 82.28.125.167, server: centovacast, request: "GET /admin/index.php?page=accounts&action=setuid&username=hgdfgfhghfd HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "newairhost.com:2199", referrer: "https://newairhost.com:2199/admin/index.php?page=accounts"
2012/09/09 09:55:38 [error] 2109#0: *3252 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 82.28.125.167, server: centovacast, request: "GET /admin/ HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "newairhost.com:2199"
appsrv-webintf-slow.log
[09-Sep-2012 09:50:52] [pool webintf] pid 14795
script_filename = /usr/local/centovacast/web/admin/index.php
[0x00007f6eadc87c40] session_start() /usr/local/centovacast/system/class_UserSession.php:351
[0x00007f6eadc875e0] __construct() /usr/local/centovacast/web/class_WebApplication.php:130
[0x00007f6eadc874a8] initialize() /usr/local/centovacast/web/admin/class_AdminApplication.php:38
[0x00007f6eadc86c10] initialize() /usr/local/centovacast/web/admin/index.php:48
[09-Sep-2012 09:50:52] [pool webintf] pid 15470
script_filename = /usr/local/centovacast/web/admin/rpc.php
[0x00007f6eadc90c40] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
[0x00007f6eadc8fe08] _get_status_quickxml() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:452
[0x00007f6eadc8d458] get_status() /usr/local/centovacast/system/class_ServerControl.php:488
[0x00007f6eadc8ccf8] api_getstatus() /usr/local/centovacast/system/class_ServerControl.php:278
[0x00007fff0a779e60] __call() unknown:0
[0x00007f6eadc8ad28] getstatus() /usr/local/centovacast/web/admin//rpc/class_RPCstreaminfo.php:41
[0x00007f6eadc8a968] _get_stream_info() /usr/local/centovacast/web/admin//rpc/class_RPCstreaminfo.php:108
[0x00007fff0a77a2c0] api_get_by_username() unknown:0
[0x00007f6eadc89be0] call_user_func_array() /usr/local/centovacast/web//rpc/class_RPCServer.php:192
[0x00007f6eadc87280] execute() /usr/local/centovacast/web/class_RPCApplication.php:324
[0x00007f6eadc86dc8] execute() /usr/local/centovacast/web/admin/rpc.php:20
[09-Sep-2012 09:52:12] [pool webintf] pid 15089
script_filename = /usr/local/centovacast/web/admin/rpc.php
[0x00007f6eadc90c60] fread() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:582
[0x00007f6eadc8fe28] _get_status_quickxml() /usr/local/centovacast/system/servers/ShoutCast2/class_ServerShoutCast2.php:452
[0x00007f6eadc8d478] get_status() /usr/local/centovacast/system/class_ServerControl.php:488
[0x00007f6eadc8cd18] api_getstatus() /usr/local/centovacast/system/class_ServerControl.php:278
[0x00007fff0a779e60] __call() unknown:0
[0x00007f6eadc8ad48] getstatus() /usr/local/centovacast/web/admin//rpc/class_RPCstreaminfo.php:41
[0x00007f6eadc8a988] _get_stream_info() /usr/local/centovacast/web/admin//rpc/class_RPCstreaminfo.php:108
[0x00007fff0a77a2c0] api_get_by_username() unknown:0
[0x00007f6eadc89c00] call_user_func_array() /usr/local/centovacast/web//rpc/class_RPCServer.php:192
[0x00007f6eadc872a0] execute() /usr/local/centovacast/web/class_RPCApplication.php:324
[0x00007f6eadc86de8] execute() /usr/local/centovacast/web/admin/rpc.php:20
-
Hello ? Its been weeks and I have turnded down countless sales because of this, is there any hope?
-
I'm having all the same issues my provider has suspended my vps due to use of excessive resources used (400%) more than available.
CentovaCast v3 & cPanel are the only items in use on the VPS
I'm also getting the following error;
Sorry, an error occurred while attempting to load the requested page.
As you increase the number of accounts & files on those accounts it seems to escalate the amount of load
& resources used on the server.
Commands Run;
/usr/local/centovacast/bin/ccmanage cronjob all
[INF] Cron job startup at 2012-09-18 12:30:31
[INF] Checking for crashed servers...
[INF] Log rotation frequency is 12, log process frequency is 12, last processed 0000-00-00 00:00:00, last rotated 2012-09-08 06:24:36, currently 2012-09-18 23:30:31, needsrotate
Result: ERROR
/usr/local/centovacast/system/runascc/runascc exec ccmanage cronjob all --debug
-bash: /usr/local/centovacast/system/runascc/runascc: No such file or directory
My Logs;
/usr/local/centovacast/var/log/cc-web.log (the nginx web server log)
2012/09/18 21:22:57 [error] 25749#0: *9371 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 127.0.0.1, server: centovacast, request: "POST /nextsong.php HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "127.0.0.1"
2012/09/18 21:25:03 [error] 25749#0: *9373 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 127.0.0.1, server: centovacast, request: "POST /nextsong.php HTTP/1.1", upstream: "fastcgi://unix:/usr/local/centovacast/var/run/cc-appserver.sock:", host: "127.0.0.1"
/usr/local/centovacast/var/log/cc-appserver.log (the php log)
[18-Sep-2012 02:15:15] NOTICE: error log file re-opened
[18-Sep-2012 02:15:15] NOTICE: Reloading in progress ...
[18-Sep-2012 02:15:15] NOTICE: reloading: execvp("/usr/local/centovacast/sbin/cc-appserver", {"/usr/local/centovacast/sbin/cc-appserver", "--fpm-config", "/usr/local/centovacast/etc/cc-appserver.conf", "-c", "/usr/local/centovacast/etc/cc-system.conf"})
[18-Sep-2012 02:15:19] NOTICE: using inherited socket fd=6, "/usr/local/centovacast/var/run/cc-appserver.sock"
[18-Sep-2012 02:15:19] NOTICE: using inherited socket fd=6, "/usr/local/centovacast/var/run/cc-appserver.sock"
[18-Sep-2012 02:15:19] NOTICE: fpm is running, pid 27884
[18-Sep-2012 02:15:19] NOTICE: ready to handle connections
[18-Sep-2012 11:19:10] NOTICE: [pool webintf] child 27903 exited with code 0 after 32630.816336 seconds from start
[18-Sep-2012 11:19:10] NOTICE: [pool webintf] child 17705 started
[18-Sep-2012 11:22:32] NOTICE: [pool webintf] child 27909 exited with code 0 after 32832.276585 seconds from start
[18-Sep-2012 11:22:32]
/usr/local/centovacast/var/log/cc-fpm.log (the php fastcgi process manager log)
no log (fastcgi not enable)
Do you know how you can reduce high server load produced by Centova cast v3??
I also use centova cast v2 & do not have any server load issues with that version.
George
-
Yep, was suspended here also, nobody has responded in weeks so I had to give up again but exact same problem, symptoms, load spikes, etc with no indication of the cause. There's always next year :(
-
I'm glad it is not just me having all these annoying issues!!
Will it be solved this year or next :-\ :-\ :'(
George
-
Yes, sorry Anthony I should have gave you more details in live chat, our data center suspended this cloud due to high server load, it is history, I think the reason was the error log was getting so huge because of the countless errors being written every minute, I think the server was having a hard time opening up the 20GIG+ file (which is kinda like notepad on your computer) to write the new errors so I had no choice but to give up, again. Have lost so much money since this was released in March 2011 and nobody seems to care or have responded in a while, I had hoped the updates they put out in past months would have corrected the problem but they have not.
At least this time other users are confirming they also have the same problem(s) and we have been using the same provider for years with zero problems so the blame on our servers just was not fair, all that time and money I have put into this have been completely wasted, meanwhile I get 100's of hits from keyword searches for "Centova v3" every day and must turn them all away.
-
Just an update, since I haven't posted in awhile -- Headshaker's detailed information helped immensely here and I believe we've found the root cause of these issues (or if not, we've found another substantial issue that needed to be resolved anyway, so either way, cheers, Headshaker!)
It looks like it's actually a combination of two separate issues that have to interact in order for the problem to manifest, which is why it's been such a difficult process to track it down.
As for why this is taking so long to "fix"... first, some background -- as you may know, v3 uses a modular architecture in which the control panel can run on one physical server/VPS, and manage multiple (local or remote) physical/VPS streaming server nodes. Right now, because the autoDJ depends on MySQL, the streaming nodes aren't fully independent -- that's a holdover from how v2.x worked. Our goal for a future release (post v3.0.0) is to eventually fully decouple the streaming nodes from the control panel by abandoning MySQL in favor of SQLite, and put the autoDJ's SQLite databases on the streaming nodes, making the streaming nodes 100% self-contained and independent.
Back on point, one of the two issues that's contributing to the problem reported in this thread is the manner in which we're allowing sc_trans2/ices to pull down track information from the control panel server in the interim. Instead of putting a quick band-aid fix on that, we're taking the time to make some more fundamental changes that not only fix this problem, but will eventually need to be made anyway to "pave the road" for the move to SQLite as well.
We're wrapping up those changes now and will have a new build out in the next few days for everyone to test.
And to everyone else with unreplied forum posts, I'll be looking at those as soon as this build is done. Sorry for the wait, but because this CPU load issue is bringing down servers, it takes priority.
-
Hurrray !!!!
You comforted me :D
Thanks for that repaly :)
-
Just an update, since I haven't posted in awhile -- Headshaker's detailed information helped immensely here and I believe we've found the root cause of these issues (or if not, we've found another substantial issue that needed to be resolved anyway, so either way, cheers, Headshaker!)
It looks like it's actually a combination of two separate issues that have to interact in order for the problem to manifest, which is why it's been such a difficult process to track it down.
As for why this is taking so long to "fix"... first, some background -- as you may know, v3 uses a modular architecture in which the control panel can run on one physical server/VPS, and manage multiple (local or remote) physical/VPS streaming server nodes. Right now, because the autoDJ depends on MySQL, the streaming nodes aren't fully independent -- that's a holdover from how v2.x worked. Our goal for a future release (post v3.0.0) is to eventually fully decouple the streaming nodes from the control panel by abandoning MySQL in favor of SQLite, and put the autoDJ's SQLite databases on the streaming nodes, making the streaming nodes 100% self-contained and independent.
Back on point, one of the two issues that's contributing to the problem reported in this thread is the manner in which we're allowing sc_trans2/ices to pull down track information from the control panel server in the interim. Instead of putting a quick band-aid fix on that, we're taking the time to make some more fundamental changes that not only fix this problem, but will eventually need to be made anyway to "pave the road" for the move to SQLite as well.
We're wrapping up those changes now and will have a new build out in the next few days for everyone to test.
And to everyone else with unreplied forum posts, I'll be looking at those as soon as this build is done. Sorry for the wait, but because this CPU load issue is bringing down servers, it takes priority.
When is the new build with all fixes going to be released !!!!!!
George
:) ;) :D ;D >:( :( :o 8) ??? ::) :-* :-\
-
we are also waiting for the new build... we have been waiting for a standalone control panel since years... and now that cc 3 is almost prepared for a RC we are getting anxious!
-
We're wrapping up those changes now and will have a new build out in the next few days for everyone to test.
So ? 'Next few days' has gone. We're still waiting.
-
We're wrapping up those changes now and will have a new build out in the next few days for everyone to test.
We're wrapping up those changes now and will have a new build out in the next few days for everyone to test.
So ? 'Next few days' has gone. We're still waiting.
So Steve B, when are we going to get the New build?
Please keep us all informed with progress instead of keeping us hanging around (Costing us Money!!)
George
-
Still nothing ???
I'm starting to be apset :/
Everyone are waiting for update for something about 2 months ??
Steve, don't You understand that You could have a lot of clients but for that You just will start to loose them ... ?
I will wait one more month, if still nothing I will leave centova....
-
I very much appreciate everyone's enthusiasm for the new release. Rest assured the delays aren't intended to piss anyone off. :)
A new build is making its way to the deployment servers now. The core stability changes we made to address the issues in this thread have been running successfully on two of our internal "semi-production" machines, and hosting a substantial number of streams, for a couple of weeks now with no issues.
Please start new threads for any issues in this new build. I'm going to lock this thread now as it's become a bit of a hodgepodge of various issues.
Thanks, all!