CSV Import

Coscast · 2010-10-12 21:56:54

Just was testing the csv mass import and mentioned an bug. Some Videos get converted to *mp4 but something goes wrong.

This is the Video:

Wow what can we say about|Wow what can we say about Layla. What a stunning girl! This youthful blond has such a soft teen like body. From her beautiful tight pussy lips to her puffy pink nipples, she goes all the way in her scorching hot videos!|Medium Boobs,Puffy Nipples,Shaved Pussy,Blonde,Long hair|http://webmastercontent.nubiles.net/layla/nubiles_layla_long.flv

Corresponding log entry:

/usr/bin/qt-faststart /srv/www/htdocs/mypornow/media/videos/mp4/1048.nometa.mp4 /srv/www/htdocs/mypornow/media/videos/mp4/1048.mp4
 0 1179407873
encountered non-QT top-level atom (is this a Quicktime file?)
last atom in file was not a moov atomFFmpeg version SVN-r25323, Copyright (c) 2000-2010 the FFmpeg developers

In order to test if it is an error in the scripts converting string, i testet with manual upload in ACP via url

http://webmastercontent.nubiles.net/layla/nubiles_layla_long.flv

with NO errors. So it seems to be a bug in the importer.

To clarify: ALL other uploads via ACP and URL work as intended including the h264 conversions. I mentioned this Bug because today i tested the Mass import for the first time

Last edited by Coscast (2010-10-12 22:09:09)

symtab · 2010-10-13 06:46:33

I will check the CSV Importer. Also in the next BETA version qt-fastart will not be needed anymore (the moov/atom repositioning be done directly from php).

Coscast · 2010-10-28 23:54:35

Just an update:

The Script tries to make mp4 videos from that csv imported videos. it looks for the nometa files in the mp4 folder, but they dont exists. Which is fairly clear, because the are in the flv folder

The thumbs get extracted, but just the conversion does not work.

Coscast · 2010-10-29 04:32:21

Just an update too:

This happens only to csvs from vidz.com as far as i see.

symtab · 2010-10-30 07:50:38

Ok. Found the problem in the code. Can you email me a video file from vidz.com that doesnt work? I just need to make sure i check correctly for mp4/flv formats.

Coscast · 2010-10-30 13:17:28

Hi,

Yes, just tested csv with this line, you may use the url to directly download the FLV:

Title|Description|Tags|FLV

Hot sexy brunette babe is neighborhood bitch|Are you new here. Did you just move here. Well those are her pick up lines for those who don't know her. She is the neighborhood bitch that is ready to give any new comer a hardcore sex that she can only bring.|on top, pool, outdoor, dog collar, hardcore, asslicking, 69, blowjob, pussy licking|http://gal3mins.vidz.com/0/7/MyNeighborsDaughter2/scene4/MyNeighborsDaughter2_scene4_Vidz.com_gal3min.flv

Last edited by Coscast (2010-10-30 13:18:40)

symtab · 2010-10-31 08:02:00

Ok. Got the problem...the file is actually a MP4/AAC file.

Input #0, flv, from 'MyNeighborsDaughter2_scene4_Vidz.com_gal3min.flv':
  Duration: 00:03:03.51, start: 0.040000, bitrate: 306 kb/s
    Stream #0.0: Video: h264, yuv420p, 512x336 [PAR 199:234 DAR 3184:2457], 306 kb/s, 25 tbr, 1k tbn, 50 tbc
    Stream #0.1: Audio: aac, 22050 Hz, mono, s16
At least one output file must be specified

Coscast · 2010-11-10 04:39:32

Hi Adrian.

Please let me know, if it is possible to mass import via vidz.com CSV, without errors about those atom bla blub.

Thank you.

symtab · 2010-11-10 11:18:07

I'm still debugging this, i found what the problem is, but i'm searching for a fix. The files for vidz are encoded incorrectly, or at least weird:

1. Its a FLV file:

file -b 675.mp4 
Macromedia Flash Video

2. Its a MP4 file:

ffmpeg -i 675.mp4 
...
Seems stream 0 codec frame rate differs from container frame rate: 50.00 (50/1) -> 25.00 (25/1)
Input #0, flv, from '675.mp4':
  Duration: 00:05:08.40, start: 0.080000, bitrate: 308 kb/s
    Stream #0.0: Video: h264, yuv420p, 512x336 [PAR 63:64 DAR 3:2], 308 kb/s, 25 tbr, 1k tbn, 50 tbc
    Stream #0.1: Audio: aac, 22050 Hz, mono, s16
At least one output file must be specified

One solution would be to run yamdi if qt-faststart fails, The script identifies this as a qt (mp4) file, which it actually is, so it runs qt-fastart by default.

symtab · 2010-11-10 11:20:10

So basically i can make it work, but without the fast forwarding player feature, because there is no way to inject meta or moov the atom (neither yamdi, nor qt-faststart work, i'm checking now with MP4Box).

symtab · 2010-11-10 11:32:47

symtab@symtab-laptop:/var/www/asp/media/videos/mp4$ MP4Box -inter 500 675.mp4
Error opening file 675.mp4: Invalid IsoMedia File
symtab@symtab-laptop:/var/www/asp/media/videos/mp4$

MP4Box cant open this file as a H264 file.

I'll also try flvtool2 (its clearly not a flv file, however file reports as a flv file, no idea why, however even if flvtool2 works, i cannot detect from the script if its a flv or mp4 file (in the vidz.com case only, for other files, detection works perfectly).

I'm going to email vidz.com and ask them about the encoding.

Coscast · 2010-11-12 12:00:14

Hmm, i don't understand that completely because, if i upload that video via single upload in ACP it converts fine. Does the Importer use a different conversion code ?

OR: Does the mass import depend on the fact that the videos are flvs already ?

symtab · 2010-11-12 14:59:03

The mass CSV import doesnt re-convert the videos. Hmm...you have a good point....what happens if you upload directly from ACP or frontend? Is the video converted to flv or hd?

Coscast · 2010-11-12 17:48:34

Tested a few minutes ago: It's flv, not HD. Uploaded via acp, single upload.

symtab · 2010-11-12 18:38:35

Ok. So there is also a bug in how i detect the video format. I will update this in BETA3 also. For our CSV problem, i think the best solution would be to use the hd file without fast forward, as re-encoding to FLV/HD will use server cpu. Still debugging.

Coscast · 2010-11-12 19:06:54

Thanks for you efforts. I understand that it could be problem, when importing very much videos, lets say hundreds. And every video has to be converted. But for me personally, i do daily updates with lets say 50 videos over the day ( not at one time and not only from vidz and mostly true flv source ). So is it possible to build a switch? For example a checkbox: Convert/Inject HD Videos Yes/No. That would be nice, because me personally would let the server convert them. On a VPS this could lead to problems, but with a ON/OFF switch this problem could be solved very smart, i think. As you know i'am not a programming expert as you and finally you should decide if that is smart or even possible.

Last edited by Coscast (2010-11-12 19:08:03)

symtab · 2010-11-12 20:39:54

Its a good idea and its possible.

Adult Script Pro Community Forums

#1 2010-10-12 21:56:54

CSV Import

#2 2010-10-13 06:46:33

Re: CSV Import

#3 2010-10-28 23:54:35

Re: CSV Import

#4 2010-10-29 04:32:21

Re: CSV Import

#5 2010-10-30 07:50:38

Re: CSV Import

#6 2010-10-30 13:17:28

Re: CSV Import

#7 2010-10-31 08:02:00

Re: CSV Import

#8 2010-11-10 04:39:32

Re: CSV Import

#9 2010-11-10 11:18:07

Re: CSV Import

#10 2010-11-10 11:20:10

Re: CSV Import

#11 2010-11-10 11:32:47

Re: CSV Import

#12 2010-11-12 12:00:14

Re: CSV Import

#13 2010-11-12 14:59:03

Re: CSV Import

#14 2010-11-12 17:48:34

Re: CSV Import

#15 2010-11-12 18:38:35

Re: CSV Import

#16 2010-11-12 19:06:54

Re: CSV Import

#17 2010-11-12 20:39:54

Re: CSV Import

Board footer