High traffic site

symtab · 2016-02-29 15:19:31

Just wanted to post a site running on 2 servers (one main server, nginx + php-fpm + mysql and one media server with nginx). Currently 6100 connections active:

[root@localhost public_html]# netstat -taunwp | grep nginx | grep EST | wc -l
6100
[root@localhost public_html]#

Double_D · 2016-02-29 18:51:57

wooow nice!!!

DuttyRock · 2016-03-02 05:15:34

Can we see the setup for nginx + php-fpm? especially nginx to see how to set ours up for maximum output

symtab · 2016-03-05 19:55:48

/etc/nginx/nginx.conf

[root@localhost ~]# cat /etc/nginx/nginx.conf 
user  nginx;
worker_processes  8;

error_log  /var/log/nginx/error.log warn;
pid        /var/run/nginx.pid;


events {
use epoll;
    worker_connections  655350;
}
worker_rlimit_nofile 655350;


http {
    include       /etc/nginx/mime.types;
    default_type  application/octet-stream;

    log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
                      '$status $body_bytes_sent "$http_referer" '
                      '"$http_user_agent" "$http_x_forwarded_for"';

    access_log  /var/log/nginx/access.log  main;

    client_max_body_size 2000M;
    
    sendfile        on;
    #tcp_nopush     on;

    keepalive_timeout  65;

    gzip  on;
    gzip_http_version 1.0;
    gzip_vary on;
    gzip_comp_level 6;
    gzip_proxied any;
    gzip_types text/plain text/html text/css application/json application/javascript application/x-javascript text/javascript text/xml application/xml application/rss+xml application/atom+xml application/rdf+xml;
    gzip_disable "MSIE [1-6]\.(?!.*SV1)";

    include /etc/nginx/conf.d/*.conf;
}
[root@localhost ~]#

The website configuration itself is nothing special, the default nginx config for adult script pro.

xpornclub · 2016-03-15 22:51:34

I have a question. I have 2 servers also, and I only have 300 active users at a time and my site is slow, I tried changing the streaming methods and nothing reduces the server load. What can we do to fix this?

My site xpornclub.com has thumbs hosted on one server and everything else on main server and still slows down both servers. I think the thumbs server was actually worse.

spankmonkey · 2016-03-16 04:05:59

xpornclub wrote:

I have a question. I have 2 servers also, and I only have 300 active users at a time and my site is slow, I tried changing the streaming methods and nothing reduces the server load. What can we do to fix this?
My site xpornclub.com has thumbs hosted on one server and everything else on main server and still slows down both servers. I think the thumbs server was actually worse.

Couple of options depending on your traffic and where the bottleneck is:

Move your database and static files to a separate server
Get a faster connection speed on your servers (1 gig+ should be plenty for serving thumbs and 300 videos at a time)
Get another server for streaming (again, high connection speed should be a major part of the decision). Put your most popular videos on it first.
Time consuming, but download your thumbs and use an image optimizer to reduce their size, then re-upload to thumb server.
Make sure compression is enabled and you are using cache correctly for all servers
Monitor your server side connections to see if you have a hotlink abuser you need to blacklist or if something is pinging you constantly

symtab · 2016-03-16 06:55:44

@xpornclub: you have crons for your other site on the server that run non-stop. every time i checked the server the crons are running. also it depends on the server specs also, the above server is a xeon e3-1230 with 16gb ram (this is for the site + mysql, not the videos). Also you host the videos on the same server...this means that there several persistent connections to stream the videos, while in the above example the videos are on a different server.

xpornclub · 2016-03-16 17:27:49

Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz and 32GB RAM on my main server. 1Gig connection
Then on 2nd server i have xeon e3-1230 with 16gb ram no cpanel on this server. Also 1 Gig connection.

I tried to move thumbs onto the 2nd server, but it does not seem to help. I agree that if I moved static files and db onto the 2nd server and left the main server for streaming it would be better.

On a side note I also just got a windows server with 16gb and 1gig connection. But never used a win server before not sure if we can use this to help anything. I was just planning on running some seo programs from it?

Can I pay you to help me with this Adrian?

Eri · 2016-03-16 18:21:44

I had 10.000 online user with GA. I was using two servers 250$ total and CDN for streaming.

and I was using
1. Cheap CDN same as xhamster use, 100 Mbps $150,00 / month or 1000 Mbps $1 250,00 / month.
2. another server for database and video thumbs (SSD HDD will be better).
3. main server using apache 2.4 is better with php than nginx (SSD HDD will be better).
4. sphinx for video search

For streaming is better to pay for CDN. If you use 100 Mbps, $150,00 / month will be perfect. Also check your connections per IP.

Last edited by Eri (2016-03-16 18:29:08)

spankmonkey · 2016-03-17 01:11:14

xpornclub- for what it's worth, without knowing your peak hours, your site has loaded without any delays for me... and I've checked it a few times. The interstitial is a bit annoying, by the way.

xpornclub · 2016-03-17 01:40:18

Yeah, I adjusted so Nginx settings and it loads better now. But my server load is like 9 or 10 of only 8 cores. But I have lots of memory available.

symtab · 2016-03-17 07:20:38

@xpornclub: we can discuss about the payment in private, but mainly i think its required that i monitor the server for a few days and try find out what is using the resources and what needs to be done. For thumbs/js/css i think its better to use CDN, its cheap. For videos separate servers (but you do not need this yet).

symtab · 2016-03-17 07:22:33

A good article to read about apache vs nginx: https://www.nginx.com/blog/nginx-vs-apache-our-view/

Adult Script Pro Community Forums

#1 2016-02-29 15:19:31

High traffic site

#2 2016-02-29 18:51:57

Re: High traffic site

#3 2016-03-02 05:15:34

Re: High traffic site

#4 2016-03-05 19:55:48

Re: High traffic site

#5 2016-03-15 22:51:34

Re: High traffic site

#6 2016-03-16 04:05:59

Re: High traffic site

#7 2016-03-16 06:55:44

Re: High traffic site

#8 2016-03-16 17:27:49

Re: High traffic site

#9 2016-03-16 18:21:44

Re: High traffic site

#10 2016-03-17 01:11:14

Re: High traffic site

#11 2016-03-17 01:40:18

Re: High traffic site

#12 2016-03-17 07:20:38

Re: High traffic site

#13 2016-03-17 07:22:33

Re: High traffic site

Board footer