Cache handling is making NAS systems slow

Next topic

Author	Message
Tony Wood	Sunday 01 June 2003 6:01:55 am A couple of issues really. The '/' in content settings is ignored when you set in '[ContentSettings]' So if you put CacheDir=/var/cache/sitename/content the system removes the first '/'. Normally this would not be a problem, but when you main site is on an external RAID array you want all your disk intensive files to to local say in /var/cache. ln -s is a way round this problem and works, but really it should be a ini command. Another thing that is noticable is that content is the only element addressed by CachDir, really this ini setting should affect 'ini' 'template' and 'template-block'. I also notice that template-block is only created once and not for every server instance of eZpublish. This means that template block can only exist on a single datasource. btw Database on muliple servers work well, its just the cache files that slows things down a bit. Comments please Tony Tony Wood : twitter.com/tonywood Vision with Technology Experts in eZ Publish consulting & development Power to the Editor! Free eZ Training : http://www.VisionWT.com/training eZ Future Podcast : http://www.VisionWT.com/eZ-Future
Bård Farstad	Monday 02 June 2003 4:11:00 am Tony, I agree on your comments. All these issues should be fixed. eZ publish should be able to have the var/ folder placed anywhere on the filesystem. Cache block should automatically use the siteaccess to create cache files, so they would be unique pr siteaccess. --bård Documentation: http://ez.no/doc
Tony Wood	Monday 02 June 2003 4:21:07 am Thanks, Will these make it into 3.1? I hope so :) as NFS is around 100 times slower than direct access and GFS is too pricey. tia tony Tony Wood : twitter.com/tonywood Vision with Technology Experts in eZ Publish consulting & development Power to the Editor! Free eZ Training : http://www.VisionWT.com/training eZ Future Podcast : http://www.VisionWT.com/eZ-Future
Bård Farstad	Tuesday 03 June 2003 2:58:41 am I've just commited a fix which enables CacheDir to be set absolute. All cache directories are then created in the desired folder, except ini cache. There is a problem with circular dependencies if we want to read from the ini file where the ini cache is beeing saved. --bård Documentation: http://ez.no/doc
Tony Wood	Tuesday 03 June 2003 3:40:13 am Thanks :) Does this mean that template-block will also be created in the CacheDir? Will this mean that if two machines are connected to a central data store on NAS the cache files will be created on both machine in /var/cache. (or the like). Meaning that template, template-block etc are created locally on both machines. Tony Wood : twitter.com/tonywood Vision with Technology Experts in eZ Publish consulting & development Power to the Editor! Free eZ Training : http://www.VisionWT.com/training eZ Future Podcast : http://www.VisionWT.com/eZ-Future
Bård Farstad	Tuesday 03 June 2003 5:01:47 am Yes, template cache files are created locally ( if that's your setup ). This means a bit more overhead in cache creation, but the speed improvements in cached views is worth it. We use a rsynct script at ez.no which syncs the files between the machines ( uploaded files etc.. ). With this setup you don't need to use NFS and friends. Mabye that's a solution for your NFS speed issues? --bård Documentation: http://ez.no/doc
Tony Wood	Tuesday 03 June 2003 5:24:46 am Thanks, Let me have a go with the new code and see where it gets me, I have moved NFS from 100 to a 1000 network card so is running a little faster. I'll take a look at rsync too, I need something pretty generic so it can work easily on all sites. I'll report back. Thanks again tony Tony Wood : twitter.com/tonywood Vision with Technology Experts in eZ Publish consulting & development Power to the Editor! Free eZ Training : http://www.VisionWT.com/training eZ Future Podcast : http://www.VisionWT.com/eZ-Future
Gabriel Ambuehl	Tuesday 03 June 2003 10:15:10 am Just how is GFS pricey if there's even a GPL edition of it, OpenGFS? Visit http://triligon.org
Tony Wood	Tuesday 03 June 2003 11:12:32 am Its more than i can justify, here an article on it http://www.hoise.com/primeur/02/articles/monthly/AE-PR-12-02-39.html Tony Wood : twitter.com/tonywood Vision with Technology Experts in eZ Publish consulting & development Power to the Editor! Free eZ Training : http://www.VisionWT.com/training eZ Future Podcast : http://www.VisionWT.com/eZ-Future

eZ debug

Timing:	Jan 18 2025 16:17:07
Script start
Timing:	Jan 18 2025 16:17:07
Module start 'layout'
Timing:	Jan 18 2025 16:17:07
Module start 'content'
Timing:	Jan 18 2025 16:17:08
Module end 'content'
Timing:	Jan 18 2025 16:17:08
Script end

Main resources:

Total runtime	0.6924 sec
Peak memory usage	4,096.0000 KB
Database Queries	77

Timing points:

Checkpoint	Start (sec)	Duration (sec)	Memory at start (KB)	Memory used (KB)
Script start	0.0000	0.0049	589.1641	152.6406
Module start 'layout'	0.0049	0.0025	741.8047	39.4766
Module start 'content'	0.0074	0.6839	781.2813	649.6406
Module end 'content'	0.6914	0.0011	1,430.9219	24.1250
Script end	0.6924		1,455.0469

Time accumulators:

Accumulator	Duration (sec)	Duration (%)	Count	Average (sec)
Ini load
Load cache	0.0031	0.4523	16	0.0002
Check MTime	0.0013	0.1927	16	0.0001
Mysql Total
Database connection	0.0007	0.1035	1	0.0007
Mysqli_queries	0.6218	89.8030	77	0.0081
Looping result	0.0007	0.0953	75	0.0000
Template Total	0.6632	95.8	2	0.3316
Template load	0.0022	0.3234	2	0.0011
Template processing	0.6610	95.4525	2	0.3305
Template load and register function	0.0001	0.0110	1	0.0001
states
state_id_array	0.0011	0.1554	1	0.0011
state_identifier_array	0.0007	0.1047	2	0.0004
Override
Cache load	0.0020	0.2881	50	0.0000
Sytem overhead
Fetch class attribute can translate value	0.0006	0.0829	3	0.0002
Fetch class attribute name	0.0021	0.3090	11	0.0002
XML
Image XML parsing	0.0009	0.1244	3	0.0003
class_abstraction
Instantiating content class attribute	0.0001	0.0079	17	0.0000
General
dbfile	0.0008	0.1204	23	0.0000
String conversion	0.0000	0.0010	4	0.0000
Note: percentages do not add up to 100% because some accumulators overlap

Templates used to render the page:

Usage	Requested template	Template	Template loaded
1	node/view/full.tpl	full/forum_topic.tpl	extension/sevenx/design/simple/override/templates/full/forum_topic.tpl
8	content/datatype/view/ezimage.tpl	<No override>	extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tpl
9	content/datatype/view/ezxmltext.tpl	<No override>	extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tpl
10	content/datatype/view/ezxmltags/paragraph.tpl	<No override>	extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tpl
1	content/datatype/view/ezxmltags/line.tpl	<No override>	design/standard/templates/content/datatype/view/ezxmltags/line.tpl
1	print_pagelayout.tpl	<No override>	extension/community/design/community/templates/print_pagelayout.tpl
Number of times templates used: 30 Number of unique templates used: 6

Time used to render debug report: 0.0001 secs