Forums / Install & configuration / MySQL troubles / Update requests

MySQL troubles / Update requests

« 
Previous topic
|
Install & configuration
|
Next topic
 »
Author Message

Romain Dausset

Tuesday 22 April 2008 2:05:12 am

Hello everybody,

We have lots of Update requests which take about 50s to be executed.

UPDATE ezcontentobject_tree SET modified_subnode=1208854300 WHERE node_id='1' OR node_id='5' OR node |...

Therefore we have between 20 and 30 request in queue, waiting to be executed.

We can see, consequently, database transaction errors and very slow connection and navigation...

Our configuration is the following :

Bi Dual Core Intel® Xeon® 5150, 4MB Cache, 2.66GHz, 1333FSB.

With apache 2.0 / mysql 5.0 on the same server.

eZ 3.9 (Passing in 4.0 is not possible...)

We tried to deporte the database on another server (Dual Core Intel(R) Xeon(TM) CPU 2.60GHz),
but without success... mysqld always takes more than 200% of CPU...

Any ideas to resolve our problem ?

Thank you in advance.

romain.dausset@gmail.com

--
Romain Dausset

rdausset@facileit.com

http://www.facileit.com

Romain Dausset

Tuesday 22 April 2008 2:18:45 am

Our configuration of MySQL is the following :


mysql> show variables;
+---------------------------------+-----------------------------+
| Variable_name                   | Value                       |
+---------------------------------+-----------------------------+
| auto_increment_increment        | 1                           |
| auto_increment_offset           | 1                           |
| automatic_sp_privileges         | ON                          |
| back_log                        | 50                          |
| basedir                         | /usr/                       |
| binlog_cache_size               | 32768                       |
| bulk_insert_buffer_size         | 8388608                     |
| character_set_client            | latin1                      |
| character_set_connection        | latin1                      |
| character_set_database          | latin1                      |
| character_set_filesystem        | binary                      |
| character_set_results           | latin1                      |
| character_set_server            | latin1                      |
| character_set_system            | utf8                        |
| character_sets_dir              | /usr/share/mysql/charsets/  |
| collation_connection            | latin1_swedish_ci           |
| collation_database              | latin1_swedish_ci           |
| collation_server                | latin1_swedish_ci           |
| completion_type                 | 0                           |
| concurrent_insert               | 1                           |
| connect_timeout                 | 5                           |
| datadir                         | /var/lib/mysql/             |
| date_format                     | %Y-%m-%d                    |
| datetime_format                 | %Y-%m-%d %H:%i:%s           |
| default_week_format             | 0                           |
| delay_key_write                 | ON                          |
| delayed_insert_limit            | 100                         |
| delayed_insert_timeout          | 300                         |
| delayed_queue_size              | 1000                        |
| div_precision_increment         | 4                           |
| engine_condition_pushdown       | OFF                         |
| expire_logs_days                | 0                           |
| flush                           | OFF                         |
| flush_time                      | 0                           |
| ft_boolean_syntax               | + -><()~*:""&|              |
| ft_max_word_len                 | 84                          |
| ft_min_word_len                 | 4                           |
| ft_query_expansion_limit        | 20                          |
| ft_stopword_file                | (built-in)                  |
| group_concat_max_len            | 1024                        |
| have_archive                    | YES                         |
| have_bdb                        | NO                          |
| have_blackhole_engine           | NO                          |
| have_compress                   | YES                         |
| have_crypt                      | YES                         |
| have_csv                        | YES                         |
| have_dynamic_loading            | YES                         |
| have_example_engine             | NO                          |
| have_federated_engine           | YES                         |
| have_geometry                   | YES                         |
| have_innodb                     | YES                         |
| have_isam                       | NO                          |
| have_merge_engine               | YES                         |
| have_ndbcluster                 | DISABLED                    |
| have_openssl                    | DISABLED                    |
| have_query_cache                | YES                         |
| have_raid                       | NO                          |
| have_rtree_keys                 | YES                         |
| have_symlink                    | YES                         |
| init_connect                    |                             |
| init_file                       |                             |
| init_slave                      |                             |
| innodb_additional_mem_pool_size | 52428800                    |
| innodb_autoextend_increment     | 8                           |
| innodb_buffer_pool_awe_mem_mb   | 0                           |
| innodb_buffer_pool_size         | 734003200                   |
| innodb_checksums                | ON                          |
| innodb_commit_concurrency       | 0                           |
| innodb_concurrency_tickets      | 500                         |
| innodb_data_file_path           | ibdata1:10M:autoextend      |
| innodb_data_home_dir            |                             |
| innodb_doublewrite              | ON                          |
| innodb_fast_shutdown            | 1                           |
| innodb_file_io_threads          | 4                           |
| innodb_file_per_table           | OFF                         |
| innodb_flush_log_at_trx_commit  | 0                           |
| innodb_flush_method             |                             |
| innodb_force_recovery           | 0                           |
| innodb_lock_wait_timeout        | 50                          |
| innodb_locks_unsafe_for_binlog  | OFF                         |
| innodb_log_arch_dir             |                             |
| innodb_log_archive              | OFF                         |
| innodb_log_buffer_size          | 1048576                     |
| innodb_log_file_size            | 5242880                     |
| innodb_log_files_in_group       | 2                           |
| innodb_log_group_home_dir       | ./                          |
| innodb_max_dirty_pages_pct      | 90                          |
| innodb_max_purge_lag            | 0                           |
| innodb_mirrored_log_groups      | 1                           |
| innodb_open_files               | 300                         |
| innodb_rollback_on_timeout      | OFF                         |
| innodb_support_xa               | ON                          |
| innodb_sync_spin_loops          | 20                          |
| innodb_table_locks              | OFF                         |
| innodb_thread_concurrency       | 8                           |
| innodb_thread_sleep_delay       | 10000                       |
| interactive_timeout             | 28800                       |
| join_buffer_size                | 131072                      |
| key_buffer_size                 | 524288000                   |
| key_cache_age_threshold         | 300                         |
| key_cache_block_size            | 1024                        |
| key_cache_division_limit        | 100                         |
| language                        | /usr/share/mysql/english/   |
| large_files_support             | ON                          |
| large_page_size                 | 0                           |
| large_pages                     | OFF                         |
| lc_time_names                   | en_US                       |
| license                         | GPL                         |
| local_infile                    | ON                          |
| locked_in_memory                | OFF                         |
| log                             | OFF                         |
| log_bin                         | OFF                         |
| log_bin_trust_function_creators | OFF                         |
| log_error                       |                             |
| log_queries_not_using_indexes   | OFF                         |
| log_slave_updates               | OFF                         |
| log_slow_queries                | ON                          |
| log_warnings                    | 1                           |
| long_query_time                 | 10                          |
| low_priority_updates            | OFF                         |
| lower_case_file_system          | OFF                         |
| lower_case_table_names          | 0                           |
| max_allowed_packet              | 16776192                    |
| max_binlog_cache_size           | 4294967295                  |
| max_binlog_size                 | 1073741824                  |
| max_connect_errors              | 10                          |
| max_connections                 | 400                         |
| max_delayed_threads             | 20                          |
| max_error_count                 | 64                          |
| max_heap_table_size             | 16777216                    |
| max_insert_delayed_threads      | 20                          |
| max_join_size                   | 18446744073709551615        |
| max_length_for_sort_data        | 1024                        |
| max_prepared_stmt_count         | 16382                       |
| max_relay_log_size              | 0                           |
| max_seeks_for_key               | 4294967295                  |
| max_sort_length                 | 1024                        |
| max_sp_recursion_depth          | 0                           |
| max_tmp_tables                  | 32                          |
| max_user_connections            | 0                           |
| max_write_lock_count            | 4294967295                  |
| multi_range_count               | 256                         |
| myisam_data_pointer_size        | 6                           |
| myisam_max_sort_file_size       | 2147483647                  |
| myisam_recover_options          | OFF                         |
| myisam_repair_threads           | 1                           |
| myisam_sort_buffer_size         | 8388608                     |
| myisam_stats_method             | nulls_unequal               |
| ndb_autoincrement_prefetch_sz   | 32                          |
| ndb_force_send                  | ON                          |
| ndb_use_exact_count             | ON                          |
| ndb_use_transactions            | ON                          |
| ndb_cache_check_time            | 0                           |
| net_buffer_length               | 16384                       |
| net_read_timeout                | 30                          |
| net_retry_count                 | 10                          |
| net_write_timeout               | 60                          |
| new                             | OFF                         |
| old_passwords                   | OFF                         |
| open_files_limit                | 8410                        |
| optimizer_prune_level           | 1                           |
| optimizer_search_depth          | 62                          |
| pid_file                        | /var/run/mysqld/mysqld.pid  |
| port                            | 3306                        |
| preload_buffer_size             | 32768                       |
| protocol_version                | 10                          |
| query_alloc_block_size          | 8192                        |
| query_cache_limit               | 1048576                     |
| query_cache_min_res_unit        | 4096                        |
| query_cache_size                | 16777216                    |
| query_cache_type                | ON                          |
| query_cache_wlock_invalidate    | OFF                         |
| query_prealloc_size             | 8192                        |
| range_alloc_block_size          | 2048                        |
| read_buffer_size                | 131072                      |
| read_only                       | OFF                         |
| read_rnd_buffer_size            | 262144                      |
| relay_log_purge                 | ON                          |
| relay_log_space_limit           | 0                           |
| rpl_recovery_rank               | 0                           |
| secure_auth                     | OFF                         |
| server_id                       | 0                           |
| skip_external_locking           | ON                          |
| skip_networking                 | OFF                         |
| skip_show_database              | OFF                         |
| slave_compressed_protocol       | OFF                         |
| slave_load_tmpdir               | /tmp/                       |
| slave_net_timeout               | 3600                        |
| slave_skip_errors               | OFF                         |
| slave_transaction_retries       | 10                          |
| slow_launch_time                | 2                           |
| socket                          | /var/run/mysqld/mysqld.sock |
| sort_buffer_size                | 3145720                     |
| sql_big_selects                 | ON                          |
| sql_mode                        |                             |
| sql_notes                       | ON                          |
| sql_warnings                    | OFF                         |
| ssl_ca                          |                             |
| ssl_capath                      |                             |
| ssl_cert                        |                             |
| ssl_cipher                      |                             |
| ssl_key                         |                             |
| storage_engine                  | MyISAM                      |
| sync_binlog                     | 0                           |
| sync_frm                        | ON                          |
| system_time_zone                | CEST                        |
| table_cache                     | 4000                        |
| table_lock_wait_timeout         | 50                          |
| table_type                      | MyISAM                      |
| thread_cache_size               | 8                           |
| thread_stack                    | 131072                      |
| time_format                     | %H:%i:%s                    |
| time_zone                       | SYSTEM                      |
| timed_mutexes                   | OFF                         |
| tmp_table_size                  | 33554432                    |
| tmpdir                          | /tmp                        |
| transaction_alloc_block_size    | 8192                        |
| transaction_prealloc_size       | 4096                        |
| tx_isolation                    | REPEATABLE-READ             |
| updatable_views_with_limit      | YES                         |
| version                         | 5.0.32-Debian_7etch5-log    |
| version_comment                 | Debian etch distribution    |
| version_compile_machine         | i486                        |
| version_compile_os              | pc-linux-gnu                |
| wait_timeout                    | 28800                       |
+---------------------------------+-----------------------------+

Thank you...

--
Romain Dausset

rdausset@facileit.com

http://www.facileit.com

eZ debug

Timing: Jan 18 2025 02:48:33
Script start
Timing: Jan 18 2025 02:48:33
Module start 'content'
Timing: Jan 18 2025 02:48:34
Module end 'content'
Timing: Jan 18 2025 02:48:34
Script end

Main resources:

Total runtime0.5808 sec
Peak memory usage4,096.0000 KB
Database Queries189

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0061 587.8281180.8281
Module start 'content' 0.00610.4738 768.6563543.6016
Module end 'content' 0.47990.1008 1,312.2578349.0625
Script end 0.5807  1,661.3203 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00410.6990210.0002
Check MTime0.00150.2652210.0001
Mysql Total
Database connection0.00100.167210.0010
Mysqli_queries0.516588.93861890.0027
Looping result0.00170.30131870.0000
Template Total0.553295.320.2766
Template load0.00240.406220.0012
Template processing0.550894.842120.2754
Template load and register function0.00010.018910.0001
states
state_id_array0.00080.133410.0008
state_identifier_array0.00060.102520.0003
Override
Cache load0.00190.3323230.0001
Sytem overhead
Fetch class attribute can translate value0.00100.174120.0005
Fetch class attribute name0.00130.217330.0004
XML
Image XML parsing0.00060.110120.0003
class_abstraction
Instantiating content class attribute0.00000.001940.0000
General
dbfile0.00290.5038270.0001
String conversion0.00000.000930.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
2content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
2content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
5content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
2content/datatype/view/ezxmltags/literal.tpl<No override>extension/community/design/standard/templates/content/datatype/view/ezxmltags/literal.tplEdit templateOverride template
1content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 14
 Number of unique templates used: 7

Time used to render debug report: 0.0002 secs