Register Members List Search Today's Posts Mark Forums Read

Reply
 
Mod Options
Import External Images Details »
Import External Images
Mod Version: 1.0.5, by y2ksw (Coder) y2ksw is offline
Developer Last Online: Jun 2019 I like it Show Printable Version Email this Page

vB Version: 4.x.x Rating: (38 votes - 4.68 average) Installs: 301
Released: 07 Nov 2010 Last Update: 14 Feb 2011 Downloads: 1862
Supported DB Changes Uses Plugins Additional Files Translations  

This vBulletin 4 product imports external images in your posts from external servers or paths into a specific path, normally your forum's image folder.

Differently than the previous product Image Cache for vBulletin 3.x., it parses the posts at regular intervals for new images and replaces the external references in the background. Also, instead of using only a single folder, it creates folders for years and months, making it much easier to handle large quantities of images. The source and destination image URL's are stored into database, too, avoiding unnecessary duplicates.

It moves and optionally converts images from one place to another. It is a handy tool in order to keep your images local to your forums.

Version 1.0.4 is temporarily in BETA stage until the users have confirmed the newly requested features.
Version 1.0.5 is still in BETA stage. It adds a new bunch of additional features, one of which allows you to test your mathematical understanding ... and a few other to fine-tune CURL and socket timeouts, and resizing on the fly of too large images. If you don't know what these options do, please leave them at their default values.

Download Now

Only licensed members can download files, Click Here for more information.

Supporters / CoAuthors

Screenshots

Click image for larger version

Name:	08-11-2010-11.32.53.jpg
Views:	3942
Size:	112.4 KB
ID:	123480   Click image for larger version

Name:	02-02-2011-22.06.39.jpg
Views:	2732
Size:	126.0 KB
ID:	126356  

Show Your Support

  • To receive notifications regarding updates -> Click to Mark as Installed.
  • If you like this modification support the author by donating.
  • This modification may not be copied, reproduced or published elsewhere without author's permission.
  #766  
Old 13 Jul 2017, 04:50
The_Hawk The_Hawk is offline
 
Join Date: Aug 2009
Actually I spoke too soon, the cron job seems to have stopped running for no apparent reason. Even trying to tell it to "run now" seems to not work.

I did hit the "Allowed memory size exhausted" error, but turned off caching... then cleared the iei_img table as well. Still no luck.

I've set the number of posts back down to 10, re-imported the mod, checked the permissions on the folders, rebooted the server... still no clue.

Other tasks still appear to be running automatically or using the "run now" button (which then shows "done"), just not this one.

I can't seem to find any error message anywhere that would point to why this is failing. Any suggestions are welcome.
Reply With Quote
  #767  
Old 15 Jul 2017, 03:44
The_Hawk The_Hawk is offline
 
Join Date: Aug 2009
So I've had a few messages back and forth with y2ksw, which has been brilliant.

The latest advice was the PHP might be silently crashing and wanted more memory. I've been slowly upping the max_memory (as I didn't want to go unlimited just yet) and it's running again. I'm somewhere north of 40,000 images checked so far (excluding photobucket) and I'm currently running at only about 40% of links being found. To be fair this is
2005 - 2011 so it's less of a surprise but really does ram home the need to run a script like this one if possible.


We had this issue in the past with very large images (like 10.000x20.000 pixel) and PHP silently crashing upon insufficient memory. If you are on a dedicated box, you may try to assign "-1" (=any) to max memory. Else, you may try to sign the first unscanned post as scanned to skip over the post which creates this problem.
Reply With Quote
  #768  
Old 16 Jul 2017, 13:16
Kane@airrifle's Avatar
Kane@airrifle Kane@airrifle is offline
 
Join Date: Jun 2011
Real name: Kane
A work around for the PB issue. edit /includes/cron/iei_cron; after line 268 add:


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

I have tested it on a few known blocked PB images and it imports them just fine.

*not my code, was posted elsewhere by "IA1"
Reply With Quote
  #769  
Old 19 Jul 2017, 21:11
fwulfers fwulfers is offline
 
Join Date: Aug 2010
Real name: Frank Wulfers
Thanks so much for this plugin and the code update for Photobucket. I installed in on our forum (vB 4.2.5), made the change to the code and it downloads the PB images just fine. Many tutorials and other important threads will now be useful again.
__________________
Saab World
Reply With Quote
  #770  
Old 20 Jul 2017, 09:23
y2ksw's Avatar
y2ksw y2ksw is offline
 
Join Date: Aug 2003
Real name: Giovanni
... and most of all, you never lose them again
__________________
Giovanni
Italian support: http://www.vbulletin.it/
Reply With Quote
  #771  
Old 20 Jul 2017, 10:01
BadgerDog BadgerDog is offline
 
Join Date: Oct 2006
Real name: Doug
Originally Posted by Kane@airrifle View Post
A work around for the PB issue. edit /includes/cron/iei_cron; after line 268 add:


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

I have tested it on a few known blocked PB images and it imports them just fine.

*not my code, was posted elsewhere by "IA1"
For my clarity ...

I donated via PayPal and have run y2ksw's for many many years. It's been fantastic and one of the most popular add-ons our members comment on.

My question ... since it's been running for so long and we already have thousands of PB pics imported onto our server, am I correct in assuming that this code change permits members to continue IMG'ing PB pics and they will still import?

In other words, this code fix works around PB's block and returns us to the status quo of what it used to be?

Thanks for any feedback?

Regards,
Doug

Edit: I don't have a line counter in my editor, so what does the code that appears before this look like so I'm sure to put this in the right place, if I do i... thanks ..

Last edited by BadgerDog; 20 Jul 2017 at 12:08.
Reply With Quote
  #772  
Old 20 Jul 2017, 14:12
Kane@airrifle's Avatar
Kane@airrifle Kane@airrifle is offline
 
Join Date: Jun 2011
Real name: Kane
Doug, the PB fix will work until such time as they find a means to obfusticate it again.

In the iei_cron.php file look for the following code and add the PB code directly after it:


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

In the long run it would assist you greatly if you used something like Notepad++ to edit your files with: https://notepad-plus-plus.org/
Reply With Quote
  #773  
Old 20 Jul 2017, 14:16
BadgerDog BadgerDog is offline
 
Join Date: Oct 2006
Real name: Doug
Originally Posted by Kane@airrifle View Post
Doug, the PB fix will work until such time as they find a means to obfusticate it again.

In the iei_cron.php file look for the following code and add the PB code directly after it:


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

In the long run it would assist you greatly if you used something like Notepad++ to edit your files with: https://notepad-plus-plus.org/
Thank you partner....

Appreciate the quick response ..

Regards,
Doug

ps: I'm on a MacBook Pro OSX operating system ..

pss: Ok, I've now inserted it for testing and it looks like this... seem like the right place?


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

psss: Well I ran it anyway and it didn't crash (see pic), so I guess I have to wait now until I can get someone to try a PB pic, as I don't use their service...
Attached Images
File Type: png Screen Shot 2017-07-20 at 10.33.10 AM.png (25.7 KB, 7 views)

Last edited by BadgerDog; 20 Jul 2017 at 14:35.
Reply With Quote
  #774  
Old 20 Jul 2017, 14:24
y2ksw's Avatar
y2ksw y2ksw is offline
 
Join Date: Aug 2003
Real name: Giovanni
Originally Posted by BadgerDog View Post
For my clarity ...

I donated via PayPal and have run y2ksw's for many many years. It's been fantastic and one of the most popular add-ons our members comment on.

My question ... since it's been running for so long and we already have thousands of PB pics imported onto our server, am I correct in assuming that this code change permits members to continue IMG'ing PB pics and they will still import?

In other words, this code fix works around PB's block and returns us to the status quo of what it used to be?

Thanks for any feedback?

Regards,
Doug

Edit: I don't have a line counter in my editor, so what does the code that appears before this look like so I'm sure to put this in the right place, if I do i... thanks ..
Sooner or later they will elaborate more and will not accept only their base url as a referrer. Until then, this code modification should work.
__________________
Giovanni
Italian support: http://www.vbulletin.it/
Reply With Quote
  #775  
Old 20 Jul 2017, 14:25
Kane@airrifle's Avatar
Kane@airrifle Kane@airrifle is offline
 
Join Date: Jun 2011
Real name: Kane
ps: I'm on a MacBook Pro OSX operating system ..
Try something like Atom then: https://atom.io/
Reply With Quote
  #776  
Old 20 Jul 2017, 14:27
BadgerDog BadgerDog is offline
 
Join Date: Oct 2006
Real name: Doug
Originally Posted by Kane@airrifle View Post
Try something like Atom then: https://atom.io/
Thanks again ..

Regards,
Doug
Reply With Quote
  #777  
Old 21 Jul 2017, 07:41
The_Hawk The_Hawk is offline
 
Join Date: Aug 2009
Originally Posted by Kane@airrifle View Post
A work around for the PB issue. edit /includes/cron/iei_cron; after line 268 add:


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

I have tested it on a few known blocked PB images and it imports them just fine.

*not my code, was posted elsewhere by "IA1"
You Sir, are a legend! (and so is IA1 for this remarkably simple fix!!)

It's ticking away nicely pulling images as we speak! I'm sitting on the edge of my seat watching it and testing images as they pull down to make sure they are continuing to work... LOVE IT!!

Originally Posted by Kane@airrifle View Post
Try something like Atom then: https://atom.io/
I like BBEdit on the Mac and Notepad++ on Windows. My old job used to use EM Editor which was great for very large files (1M+ lines files dumped from finance systems), but Notepad++ works fine for my coding needs.

BBEdit:
http://www.barebones.com/

EM Editor:
https://www.emeditor.com/

Last edited by The_Hawk; 21 Jul 2017 at 08:19.
Reply With Quote
  #778  
Old 25 Jul 2017, 11:22
BadgerDog BadgerDog is offline
 
Join Date: Oct 2006
Real name: Doug
Originally Posted by Kane@airrifle View Post
A work around for the PB issue. edit /includes/cron/iei_cron; after line 268 add:


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

I have tested it on a few known blocked PB images and it imports them just fine.

*not my code, was posted elsewhere by "IA1"
Just a follow up and again, a huge thank you for this quick fix (for now)...

It's working beautifully and being a research site for over 29,000 retired veterans, is extremely valuable to our members... much appreciated...

We've been using y2ksw's outstanding add-on for over 7 years and the accumulated amount of important Photo Bucket research pics that have been preserved (saved) by his mod over the years is measured in the 10's of thousands.

Your temporary fix allows that to continue with new pics, at least until Photo Bucket catches up with it.

Regards,
Doug
Reply With Quote
  #779  
Old 25 Jul 2017, 14:34
rkrenicki rkrenicki is offline
 
Join Date: Dec 2014
I think I am missing something real simple here.. but I am not finding a log entry for this mod. Does this not have logging functions, or am I missing where to enable it?

EDIT: Nevermind, i found it and it is logging now.

Last edited by rkrenicki; 25 Jul 2017 at 15:08.
Reply With Quote
  #780  
Old 25 Jul 2017, 15:10
Kane@airrifle's Avatar
Kane@airrifle Kane@airrifle is offline
 
Join Date: Jun 2011
Real name: Kane
It's not set to log the cron action by default but it does write the imports (old_url - new_url) to a DB table called "iei_img"
Reply With Quote
Reply

Tags
lisansdevir


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Mod Options

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


New To Site? Need Help?

All times are GMT. The time now is 20:56.

Layout Options | Width: Wide Color: