Best way to removing old RSS files

Thursday 01 September 2005 3:07:02 am

On my site I have 100 + RSS feeds that are updated once a day with cron.
But removing old RSS files is painful since you only can view 50 nodes at a time.
So I wondered if there is a way to search for a node type and then display all of them at the same time. So that I cud remove all at once?

Thursday 01 September 2005 7:17:27 am

Can you explain that more?
Do you mean that I shod create a script and run that in cron? Like http://ez.no/content/view/full/52779

Thursday 01 September 2005 8:39:16 am

Do you know the node_id of the trash, since I am kind of lazy I am thinking of just using one of the moving script and then move all old rss files to trash.
Or do you have a scrip that deletes old files ready?

Wednesday 17 January 2007 8:56:42 pm

Here is one solution to getting rid of old RSS data.

It is an adaptation of other code posted in the forums - with thanks to those contributors.

I used a custom class to store the incoming RSS data. This script, which is run by <b>runcronjobs</b>, fetches the RSS nodes in descending order of publication. Therefore, the newest nodes are first. An ini setting is used to define the initial fetch offset, which preserves the first n objects (where n=MaxRSSObjects). All remaining objects are deleted.

Remember to update cronjobs.ini to add this to the list. This can be run standalone, too - for testing. There is an attribute filter, but in this case, I want to keep only the 50 most recent objects, regardless of the actual publication date.

This is feed independent - so all RSS data will be processed.

//init shell script

include_once( 'kernel/classes/ezcontentobject.php' );
include_once( 'kernel/classes/ezcontentobjecttreenode.php' );
include_once( 'kernel/classes/ezcontentobjecttreenodeoperations.php' );

include_once( "lib/ezutils/classes/ezextension.php" );
include_once( "lib/ezutils/classes/ezmodule.php" );
include_once( 'lib/ezutils/classes/ezcli.php' );
include_once( 'lib/ezutils/classes/ezini.php' );
include_once( 'kernel/classes/ezscript.php' );

define ('SUBTREE_LIMIT',50);

if (!isset($script))
{
        $script =& eZScript::instance( array( 'debug-message' => true,
                                      'use-session' => true,
                                      'use-modules' => true,
                                      'use-extensions' => true ) );
        $script->startup();
        $script->initialize();
        $standalone=true;
}
else
        $standalone=false;

if (!isset($cli))
{
        $cli =& eZCLI::instance();
        $cli->setUseStyles( true ); // enable colors
}

$user = eZUser::fetchByName('Admin'); //*** ez administror
$userID = $user->attribute( 'contentobject_id' );
eZUser::setCurrentlyLoggedInUser( $user, $userID );

$today=getdate();
$time=mktime(0,0,0,$today['mon'],$today['mday'],$today['year']);

$cli->output('Checking for RSS objects',true);

$ini =& eZINI::instance();
$max_RSS_objects = (int)$ini->variable( "RSSSettings","MaxRSSObjects" );
$cli->output('Current limit is '.$max_RSS_objects.' RSS objects',true);

get_RSS_nodes($time,$max_RSS_objects);

$cli->output('Done',true);
if ($standalone)
        $script->shutdown();

function get_RSS_nodes ($today,$max_RSS_objects)
{
        global $cli;
        $offset=$max_RSS_objects;
        $done=FALSE;
        do
        {
                $params=array(
                        'ClassFilterType' => 'include',
                        'ClassFilterArray' => array(33),
                        'Limit' => SUBTREE_LIMIT,
                        'Depth' => 0,
                        'Offset' => $offset,
                        'SortBy' => array( 'published',false ),
//                        'AttributeFilter' => array('and',array('published','<=',$today)),
                        'status' => EZ_CONTENT_OBJECT_STATUS_PUBLISHED);
                $childNodes =& eZContentObjectTreeNode::subTree($params,2);
                if (count($childNodes) === 0)
                        $done=TRUE;
                else
                {
                        foreach( $childNodes as $child )
                        {
                                $deleteIDArray[] = $id = $child->attribute( 'main_node_id' );
                                $cli->output('Deleting: '.$child->attribute('name').' ['.$id.']',true);
                        }
                        eZContentObjectTreeNode::removeSubtrees( $deleteIDArray, false );
                        unset ($childNodes);
                }
        }
        while (!$done);
}
?>

Thursday 18 January 2007 9:18:52 am

A small modification would improve the portability of the script between sites: replace the class id 33 with a class identifier.

Anyway, nice contribution Betsy!

independent eZ Publish developer and service provider | http://blog.coomanskristof.be | http://ezpedia.org

Monday 22 January 2007 4:43:00 am

Well I think the idea is to push for more than another offshoot run once script, in general.

This script could easily accept these specific variables as arguments.

<i>//kracker

The Rentals - Friends of P
</i>

Member since: 2001.07.13 || http://ezpedia.se7enx.com/

Wednesday 20 May 2009 4:19:31 am

Hi everyone,

Just wanted to know if anybody managed to make this script work on ez publish 4.1.1

I get this error :

Using $this when not in object context in /../../ezcontentobjecttreenode.php on line 1965

thank you

Wednesday 20 May 2009 7:48:26 am

Thank you for this very fast answer. Error message has gone. But objects are not deleted.

Here the output :

Running cronjobs/rssdelete.php
Checking for RSS objects
Current limit is 10 RSS objects per feed
Forum (my parent_node name)
Done

I guess the problem si somewhere in this piece of code, but I don't understand much in it.

$cli->output('Done',true);
if ($standalone)
        $script->shutdown();

function get_RSS_nodes ($today,$max_RSS_objects,$parentNodeID)
{
        global $cli;
 
        if ($max_RSS_objects === 0) return;
 
        $offset=$max_RSS_objects;
        $done=FALSE;
        do
        {
                $params=array(
                        'ClassFilterType' => 'include',
                        'ClassFilterArray' => array(33),
                        'Limit' => SUBTREE_LIMIT,
                        'Depth' => 0,
                        'Offset' => $offset,
                        'SortBy' => array( 'published',false ),
//                        'AttributeFilter' => array('and',array('published','<=',$today)),
                        'status' => EZ_CONTENT_OBJECT_STATUS_PUBLISHED);
                $childNodes =& eZContentObjectTreeNode::subTreeByNodeID($params,$parentNodeID);
                if (count($childNodes) === 0)
                        $done=TRUE;
                else
                {
                        foreach( $childNodes as $child )
                        {
                                $deleteIDArray[] = $id = $child->attribute( 'main_node_id' );
                                $cli->output('Deleting: '.$child->attribute('name').' ['.$id.']',true);
                        }
                        eZContentObjectTreeNode::removeSubtrees( $deleteIDArray, false );
                        unset ($childNodes);
                }
        }
        while (!$done);
} 

Wednesday 20 May 2009 9:04:45 am

Awesome, it works now.

In fact it wasn't that hard to find. It's only that my 'ClassFilterArray' wa wrong.

I found out using

$cli->output(count($childNodes));

which of course resulted by 0.

Thanks a lot.

Saturday 18 July 2009 6:57:00 pm

@ Lulio Vargas

Take a look at the BC Cleanup RSS extension [0]
Which is compatible with eZ Publish 4.0+

Cheers,
Heath

[0] <i>http://ez.no/developer/contribs/cronjobs/bc_cleanup_rss</i>
[1] <i>http://ez.no/content/download/275036/2529830/file/bccleanuprss.0.0.17.tar.gz</i>
[2] <i>http://projects.ez.no/bccleanuprss</i>

Brookins Consulting | http://brookinsconsulting.com/
Certified | http://auth.ez.no/certification/verify/380350
Solutions | http://projects.ez.no/users/community/brookins_consulting
eZpedia community documentation project | http://ezpedia.org