Adult Script Pro Community Forums

The forum is here for legacy reasons. No new posts will be created. User registration is disabled! If you have any questions, please email us or check https://www.adultscriptpro.com for more details!

You are not logged in.

#1 2012-02-26 07:41:08

THS
Member
Registered: 2012-02-02
Posts: 313
Website

Stuck in grabbing - maybe?

I did a large CSV import (>1000 vids) and all went fairly well, except it appears to have gone all the way through processing (progress bar wise) and then it gave a 404 on not able to find this page:  /admin/index.php?q=video.  Interestingly enough, it displayed the non-admin video page for the error (might be an issue in the error template) even though the URL was in the admin.  I still do not have any videos displayed and in the video admin section it shows the videos, everything appears to have been imported except all the thumbs are blank and the status is grabbing.  How long does this take and did something go wrong?

Here is a sample of the CSV:

<object height="480" width="640"><param name="allowfullscreen" value="false"><param name="AllowScriptAccess" value="always"><param name="movie" value="http://embed.redtube.com/player/"><param name="FlashVars" value="id=140407&style=redtube&autostart=false"><embed src="http://embed.redtube.com/player/?id=140407&style=redtube" allowfullscreen="false" AllowScriptAccess="always" flashvars="autostart=false" pluginspage="http://www.adobe.com/shockwave/download/download.cgi?P1_Prod_Version=ShockwaveFlash" type="application/x-shockwave-flash" height="480" width="640" /></object>|http://img01.redtubefiles.com/_thumbs/0000140/0140407/0140407_002.jpg;http://img03.redtubefiles.com/_thumbs/0000140/0140407/0140407_003.jpg;http://img01.redtubefiles.com/_thumbs/0000140/0140407/0140407_004.jpg;http://img01.redtubefiles.com/_thumbs/0000140/0140407/0140407_005.jpg;http://img03.redtubefiles.com/_thumbs/0000140/0140407/0140407_006.jpg;http://img03.redtubefiles.com/_thumbs/0000140/0140407/0140407_007.jpg;http://img02.redtubefiles.com/_thumbs/0000140/0140407/0140407_008.jpg;http://img04.redtubefiles.com/_thumbs/0000140/0140407/0140407_009.jpg;http://img02.redtubefiles.com/_thumbs/0000140/0140407/0140407_010.jpg;http://img02.redtubefiles.com/_thumbs/0000140/0140407/0140407_011.jpg;http://img01.redtubefiles.com/_thumbs/0000140/0140407/0140407_012.jpg;http://img01.redtubefiles.com/_thumbs/0000140/0140407/0140407_013.jpg;http://img01.redtubefiles.com/_thumbs/0000140/0140407/0140407_014.jpg;http://img01.redtubefiles.com/_thumbs/0000140/0140407/0140407_015.jpg;http://img03.redtubefiles.com/_thumbs/0000140/0140407/0140407_016.jpg|Rebeca queen of blow jobs|Big Tits;Blowjob;Cumshot|13m55s|	
<object height="480" width="640"><param name="allowfullscreen" value="false"><param name="AllowScriptAccess" value="always"><param name="movie" value="http://embed.redtube.com/player/"><param name="FlashVars" value="id=121330&style=redtube&autostart=false"><embed src="http://embed.redtube.com/player/?id=121330&style=redtube" allowfullscreen="false" AllowScriptAccess="always" flashvars="autostart=false" pluginspage="http://www.adobe.com/shockwave/download/download.cgi?P1_Prod_Version=ShockwaveFlash" type="application/x-shockwave-flash" height="480" width="640" /></object>|http://img04.redtubefiles.com/_thumbs/0000121/0121330/0121330_002.jpg;http://img04.redtubefiles.com/_thumbs/0000121/0121330/0121330_003.jpg;http://img01.redtubefiles.com/_thumbs/0000121/0121330/0121330_004.jpg;http://img03.redtubefiles.com/_thumbs/0000121/0121330/0121330_005.jpg;http://img01.redtubefiles.com/_thumbs/0000121/0121330/0121330_007.jpg;http://img03.redtubefiles.com/_thumbs/0000121/0121330/0121330_008.jpg;http://img04.redtubefiles.com/_thumbs/0000121/0121330/0121330_010.jpg;http://img02.redtubefiles.com/_thumbs/0000121/0121330/0121330_011.jpg;http://img01.redtubefiles.com/_thumbs/0000121/0121330/0121330_013.jpg;http://img04.redtubefiles.com/_thumbs/0000121/0121330/0121330_014.jpg;http://img02.redtubefiles.com/_thumbs/0000121/0121330/0121330_015.jpg;http://img04.redtubefiles.com/_thumbs/0000121/0121330/0121330_016.jpg|Gladiator on his mission|Gay;Cumshot;Ebony|21m40s|		
<object height="480" width="640"><param name="allowfullscreen" value="false"><param name="AllowScriptAccess" value="always"><param name="movie" value="http://embed.redtube.com/player/"><param name="FlashVars" value="id=70250&style=redtube&autostart=false"><embed src="http://embed.redtube.com/player/?id=70250&style=redtube" allowfullscreen="false" AllowScriptAccess="always" flashvars="autostart=false" pluginspage="http://www.adobe.com/shockwave/download/download.cgi?P1_Prod_Version=ShockwaveFlash" type="application/x-shockwave-flash" height="480" width="640" /></object>|http://img04.redtubefiles.com/_thumbs/0000070/0070250/0070250_001.jpg;http://img04.redtubefiles.com/_thumbs/0000070/0070250/0070250_002.jpg;http://img02.redtubefiles.com/_thumbs/0000070/0070250/0070250_003.jpg;http://img02.redtubefiles.com/_thumbs/0000070/0070250/0070250_004.jpg;http://img04.redtubefiles.com/_thumbs/0000070/0070250/0070250_005.jpg;http://img03.redtubefiles.com/_thumbs/0000070/0070250/0070250_006.jpg;http://img04.redtubefiles.com/_thumbs/0000070/0070250/0070250_007.jpg;http://img03.redtubefiles.com/_thumbs/0000070/0070250/0070250_009.jpg;http://img04.redtubefiles.com/_thumbs/0000070/0070250/0070250_010.jpg;http://img03.redtubefiles.com/_thumbs/0000070/0070250/0070250_011.jpg;http://img04.redtubefiles.com/_thumbs/0000070/0070250/0070250_012.jpg;http://img02.redtubefiles.com/_thumbs/0000070/0070250/0070250_013.jpg;http://img04.redtubefiles.com/_thumbs/0000070/0070250/0070250_014.jpg;http://img01.redtubefiles.com/_thumbs/0000070/0070250/0070250_015.jpg;http://img03.redtubefiles.com/_thumbs/0000070/0070250/0070250_016.jpg|Dicks in ass and pussy for Nikki Hunter|Anal;Group;Facials;Double Penetration|34m03s|		
<object height="480" width="640"><param name="allowfullscreen" value="false"><param name="AllowScriptAccess" value="always"><param name="movie" value="http://embed.redtube.com/player/"><param name="FlashVars" value="id=59499&style=redtube&autostart=false"><embed src="http://embed.redtube.com/player/?id=59499&style=redtube" allowfullscreen="false" AllowScriptAccess="always" flashvars="autostart=false" pluginspage="http://www.adobe.com/shockwave/download/download.cgi?P1_Prod_Version=ShockwaveFlash" type="application/x-shockwave-flash" height="480" width="640" /></object>|http://img04.redtubefiles.com/_thumbs/0000059/0059499/0059499_001.jpg;http://img02.redtubefiles.com/_thumbs/0000059/0059499/0059499_002.jpg;http://img01.redtubefiles.com/_thumbs/0000059/0059499/0059499_003.jpg;http://img04.redtubefiles.com/_thumbs/0000059/0059499/0059499_004.jpg;http://img01.redtubefiles.com/_thumbs/0000059/0059499/0059499_005.jpg;http://img02.redtubefiles.com/_thumbs/0000059/0059499/0059499_006.jpg;http://img03.redtubefiles.com/_thumbs/0000059/0059499/0059499_007.jpg;http://img02.redtubefiles.com/_thumbs/0000059/0059499/0059499_008.jpg;http://img02.redtubefiles.com/_thumbs/0000059/0059499/0059499_009.jpg;http://img03.redtubefiles.com/_thumbs/0000059/0059499/0059499_010.jpg;http://img03.redtubefiles.com/_thumbs/0000059/0059499/0059499_011.jpg;http://img03.redtubefiles.com/_thumbs/0000059/0059499/0059499_012.jpg;http://img03.redtubefiles.com/_thumbs/0000059/0059499/0059499_013.jpg;http://img02.redtubefiles.com/_thumbs/0000059/0059499/0059499_014.jpg;http://img03.redtubefiles.com/_thumbs/0000059/0059499/0059499_015.jpg;http://img02.redtubefiles.com/_thumbs/0000059/0059499/0059499_016.jpg|Mature woman makes him happy|Blowjob;Amateur;Cumshot;Mature|15m09s|		
<object height="480" width="640"><param name="allowfullscreen" value="false"><param name="AllowScriptAccess" value="always"><param name="movie" value="http://embed.redtube.com/player/"><param name="FlashVars" value="id=69915&style=redtube&autostart=false"><embed src="http://embed.redtube.com/player/?id=69915&style=redtube" allowfullscreen="false" AllowScriptAccess="always" flashvars="autostart=false" pluginspage="http://www.adobe.com/shockwave/download/download.cgi?P1_Prod_Version=ShockwaveFlash" type="application/x-shockwave-flash" height="480" width="640" /></object>|http://img02.redtubefiles.com/_thumbs/0000069/0069915/0069915_001.jpg;http://img02.redtubefiles.com/_thumbs/0000069/0069915/0069915_002.jpg;http://img02.redtubefiles.com/_thumbs/0000069/0069915/0069915_003.jpg;http://img02.redtubefiles.com/_thumbs/0000069/0069915/0069915_004.jpg;http://img04.redtubefiles.com/_thumbs/0000069/0069915/0069915_005.jpg;http://img01.redtubefiles.com/_thumbs/0000069/0069915/0069915_006.jpg;http://img04.redtubefiles.com/_thumbs/0000069/0069915/0069915_007.jpg;http://img01.redtubefiles.com/_thumbs/0000069/0069915/0069915_008.jpg;http://img03.redtubefiles.com/_thumbs/0000069/0069915/0069915_009.jpg;http://img03.redtubefiles.com/_thumbs/0000069/0069915/0069915_010.jpg;http://img04.redtubefiles.com/_thumbs/0000069/0069915/0069915_011.jpg;http://img01.redtubefiles.com/_thumbs/0000069/0069915/0069915_012.jpg;http://img04.redtubefiles.com/_thumbs/0000069/0069915/0069915_013.jpg;http://img02.redtubefiles.com/_thumbs/0000069/0069915/0069915_014.jpg;http://img03.redtubefiles.com/_thumbs/0000069/0069915/0069915_015.jpg;http://img01.redtubefiles.com/_thumbs/0000069/0069915/0069915_016.jpg|Sharon Lee gets her ass stretched out|Anal;Asian;Lingerie|28m58s|		

Offline

#2 2012-02-26 08:36:00

symtab
Administrator
Registered: 2010-08-23
Posts: 7,501
Website

Re: Stuck in grabbing - maybe?

Hmmm...if you format the CSV in another way it might works, like:
embed|url-to-only-one-thumb|title|tags-categories|duration

With that many URLs for thumbs, it doesnt work, however i will add this feature in 1.0 right now (basically if the thumb url contains; then separate the urls and download all thumbs).


Adult Scripts: Adult Script Pro - Adult Search Script
Adult Advertising/Traffic: Plug Rush - EXOClick - PopAds

Offline

#3 2012-02-26 08:53:55

symtab
Administrator
Registered: 2010-08-23
Posts: 7,501
Website

Re: Stuck in grabbing - maybe?

This small feature is added in 1.0 (basically this will allow importing videos from tubes via the CSV importer). See screenshots with your CSV:
redtube_csv.png
redtube_csv_done.png


Adult Scripts: Adult Script Pro - Adult Search Script
Adult Advertising/Traffic: Plug Rush - EXOClick - PopAds

Offline

#4 2012-02-26 18:55:54

THS
Member
Registered: 2012-02-02
Posts: 313
Website

Re: Stuck in grabbing - maybe?

What files need to be modified or is it too many and I just have to wait for 1.0?  If not, I could really use this.  Thanks!

Offline

#5 2012-02-27 06:11:24

symtab
Administrator
Registered: 2010-08-23
Posts: 7,501
Website

Re: Stuck in grabbing - maybe?

You need to modify admin/modules/csv.php and replace below code:

                            $this->update_progress($progress.'^Processing: '.$values['title'].' (downloading thumb) ...');
                                    
                            $thumb_dir  = MEDIA_DIR.'/videos/tmb/'.path($video_id);
                            VFolder::create($thumb_dir);
                            $thumb_dst  = $thumb_dir.'/1.jpg';
                            if (!VCurl::file(trim($values['thumb']), $thumb_dst)) {
                                $progress = sprintf("%01.2f", ($progress+$incr));
                                $this->update_progress($progress.'^Failed to download video thumb...skiping!');
                                continue;
                            }

                            if (RESIZE_THUMB === true) {
                                $thumb_tmp = TMP_DIR.'/thumbs/'.$video_id.'.jpg';
                                if (!$image->load($thumb_dst) OR
                                    !$image->resize($this->vcfg['thumb_width'], $this->vcfg['thumb_height'], 'EXACT', $thumb_tmp)) {
                                    $progress = sprintf("%01.2f", ($progress+$incr));
                                    $this->update_progress($progress.'^Failed to load video thumb...skiping!');
                                    continue;
                                }
                                
                                rename($thumb_tmp, $thumb_dst);

                                $thumbs = 1;
                            }

with:

                                                        $this->update_progress($progress.'^Processing: '.$values['title'].' (downloading thumb) ...');

                                                        // lets get more than one URL here
                                                        $urls           = array();
                                                        if (strpos($values['thumb'], ';') !== FALSE) {
                                                                $urls   = explode(';', $values['thumb']);
                                                        } else {
                                                                $urls[] = $values['thumb'];
                                                        }

                                                        $thumbs = 1;
                                                        foreach ($urls as $thumb) {
                                                                $thumb_dir      = MEDIA_DIR.'/videos/tmb/'.path($video_id);
                                                                VFolder::create($thumb_dir);
                                                                $thumb_dst      = $thumb_dir.'/'.$thumbs.'.jpg';
                                                                if (!VCurl::file(trim($thumb), $thumb_dst)) {
                                                                        $progress = sprintf("%01.2f", ($progress+$incr));
                                                                        $this->update_progress($progress.'^Failed to download video thumb...skiping!');
                                                                        continue;
                                                                }

                                                                if (RESIZE_THUMB === true) {
                                                                        $thumb_tmp = TMP_DIR.'/thumbs/'.$video_id.'.jpg';

                                                                        $image->clear();
                                                                        if (!$image->load($thumb_dst)) {
                                                                                $progress = sprintf("%01.2f", ($progress+$incr));
                                                                                $this->update_progress($progress.'^Failed to load video thumb...skiping!');
                                                                                continue;
                                                                        }

                                                                        if (!$image->resize($this->vcfg['thumb_width'], $this->vcfg['thumb_height'], 'EXACT', $thumb_tmp)) {
                                                                                $progress = sprintf("%01.2f", ($progress+$incr));
                                                                                $this->update_progress($progress.'^Failed to resize video thumb...skiping!');
                                                                                continue;
                                                        $this->update_progress($progress.'^Processing: '.$values['title'].' (downloading thumb) ...');

                                                        // lets get more than one URL here
                                                        $urls           = array();
                                                        if (strpos($values['thumb'], ';') !== FALSE) {
                                                                $urls   = explode(';', $values['thumb']);
                                                        } else {
                                                                $urls[] = $values['thumb'];
                                                        }

                                                        $thumbs = 1;
                                                        foreach ($urls as $thumb) {
                                                                $thumb_dir      = MEDIA_DIR.'/videos/tmb/'.path($video_id);
                                                                VFolder::create($thumb_dir);
                                                                $thumb_dst      = $thumb_dir.'/'.$thumbs.'.jpg';
                                                                if (!VCurl::file(trim($thumb), $thumb_dst)) {
                                                                        $progress = sprintf("%01.2f", ($progress+$incr));
                                                                        $this->update_progress($progress.'^Failed to download video thumb...skiping!');
                                                                        continue;
                                                                }

                                                                if (RESIZE_THUMB === true) {
                                                                        $thumb_tmp = TMP_DIR.'/thumbs/'.$video_id.'.jpg';

                                                                        $image->clear();
                                                                        if (!$image->load($thumb_dst)) {
                                                                                $progress = sprintf("%01.2f", ($progress+$incr));
                                                                                $this->update_progress($progress.'^Failed to load video thumb...skiping!');
                                                                                continue;
                                                                        }

                                                                        if (!$image->resize($this->vcfg['thumb_width'], $this->vcfg['thumb_height'], 'EXACT', $thumb_tmp)) {
                                                                                $progress = sprintf("%01.2f", ($progress+$incr));
                                                                                $this->update_progress($progress.'^Failed to resize video thumb...skiping!');
                                                                                continue;
                                                                        }
                                                                }

                                                                rename($thumb_tmp, $thumb_dst);

                                                                ++$thumbs;
                                                        }
                                    $thumbs = ($thumbs === 1) ? 1 : ($thumbs-1);
                       }

Adult Scripts: Adult Script Pro - Adult Search Script
Adult Advertising/Traffic: Plug Rush - EXOClick - PopAds

Offline

#6 2012-02-27 06:53:05

THS
Member
Registered: 2012-02-02
Posts: 313
Website

Re: Stuck in grabbing - maybe?

Thanks!!!

Offline

#7 2012-02-28 02:57:47

THS
Member
Registered: 2012-02-02
Posts: 313
Website

Re: Stuck in grabbing - maybe?

Symtab, can you post the whole file for download or such?  I did the mod and had no problem finding the lines, but now I get a 500 ISE.  This occurs when I try to get to the Mass CSV import page.

Offline

#8 2012-02-28 06:25:46

symtab
Administrator
Registered: 2010-08-23
Posts: 7,501
Website

Re: Stuck in grabbing - maybe?

Please email me FTP access and i'll add the code. I cannot send you the entire file because it will not work (some new features/vars in 1.0).


Adult Scripts: Adult Script Pro - Adult Search Script
Adult Advertising/Traffic: Plug Rush - EXOClick - PopAds

Offline

#9 2012-02-29 08:06:53

symtab
Administrator
Registered: 2010-08-23
Posts: 7,501
Website

Re: Stuck in grabbing - maybe?

Fixed.


Adult Scripts: Adult Script Pro - Adult Search Script
Adult Advertising/Traffic: Plug Rush - EXOClick - PopAds

Offline

#10 2012-02-29 08:40:49

keiooz
Member
Registered: 2012-02-27
Posts: 20

Re: Stuck in grabbing - maybe?

I just read this thread and I got overwhelmed. I guess I still need to study more about it.


Went down deep!! good.gif

Offline

#11 2012-02-29 08:45:34

symtab
Administrator
Registered: 2010-08-23
Posts: 7,501
Website

Re: Stuck in grabbing - maybe?

@keiooz: if you have any questions just let me know and will try to help.


Adult Scripts: Adult Script Pro - Adult Search Script
Adult Advertising/Traffic: Plug Rush - EXOClick - PopAds

Offline

#12 2012-03-01 02:03:11

THS
Member
Registered: 2012-02-02
Posts: 313
Website

Re: Stuck in grabbing - maybe?

What is the limit on import field for?  I see it limits how many are imported but why would we not want to process the whole CSV file?

Offline

#13 2012-03-01 06:40:12

symtab
Administrator
Registered: 2010-08-23
Posts: 7,501
Website

Re: Stuck in grabbing - maybe?

You can set a limit to whatever you want and the use the same file again. I configured it this way, because i personally what content from more sponsors mixed, not 1000 videos from the same sponsor. Of course this can be changed, simply by adding 10.000 to the limit.


Adult Scripts: Adult Script Pro - Adult Search Script
Adult Advertising/Traffic: Plug Rush - EXOClick - PopAds

Offline

#14 2012-03-01 14:00:34

THS
Member
Registered: 2012-02-02
Posts: 313
Website

Re: Stuck in grabbing - maybe?

Ah, ok.  That makes sense.

Offline

Board footer

Powered by FluxBB