Forums / Developer / PDF and UTF-8 database

PDF and UTF-8 database

Author Message

Heiner Wurbs

Wednesday 23 August 2006 5:20:16 am

Hi !

I have a 3.8.3 UTF-8 database and the pdf creation looks like described in this bug:

http://ez.no/community/bugs/pdf_content_pdf_problem_with_utf_8_and_or_german_umlauts

Special characters like ÄÖÜ and so on are destroyed. Whats the problem ?
Greetings
heiner

Valentin Doroschuk

Wednesday 23 August 2006 5:42:13 am

The problem is
PDF uses WinAnsiEncoding (by default),
If you have UTf-8 db/site,
and if you try to create PDF with UTF-8 symbols
this symbols will be shown like latin1
and special chars will be destroyed.

There is a quick fix:
We should convert text from UTF-8 to latin before executing pdf lib.

Index: settings/pdf.ini 
=================================================================== 
--- settings/pdf.ini    (revision 16510) 
+++ settings/pdf.ini    (working copy) 
@@ -16,6 +16,7 @@ 
 BottomMargin=100 
 LeftMargin=80 
 RightMargin=80 
+OutputCharset=iso-8859-15 
  
 [Header] 
 Page=all 
Index: lib/ezpdf/classes/ezpdf.php 
=================================================================== 
--- lib/ezpdf/classes/ezpdf.php (revision 16510) 
+++ lib/ezpdf/classes/ezpdf.php (working copy) 
@@ -329,6 +329,15 @@ 
  
                 $text = str_replace( array( ' ', "\n", "\t" ), '', $text ); 
  
+                include_once( 'lib/ezi18n/classes/eztextcodec.php' ); 
+                $httpCharset = eZTextCodec::httpCharset(); 
+                $outputCharset = $config->hasVariable( 'PDFGeneral', 'OutputCharset' ) 
+                                 ? $config->variable( 'PDFGeneral', 'OutputCharset' ) 
+                                 : 'iso-8859-15'; 
+                $codec =& eZTextCodec::instance( $httpCharset, $outputCharset ); 
+                // Convert current text to $outputCharset (by default iso-8859-15) 
+                $text =& $codec->convertString( $text ); 
+ 
                 $this->PDF->ezText( $text ); 
                 eZDebug::writeNotice( 'Execute text in PDF, length: "'. strlen( $text ) .'"', 'eZPDF::modify' ); 
             } break; 

eZ debug

Timing: Jan 18 2025 16:08:39
Script start
Timing: Jan 18 2025 16:08:39
Module start 'content'
Timing: Jan 18 2025 16:08:39
Module end 'content'
Timing: Jan 18 2025 16:08:39
Script end

Main resources:

Total runtime0.6792 sec
Peak memory usage4,096.0000 KB
Database Queries191

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0064 589.4609180.8438
Module start 'content' 0.00640.5560 770.3047503.2969
Module end 'content' 0.56240.1167 1,273.6016332.7734
Script end 0.6791  1,606.3750 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.00410.6013210.0002
Check MTime0.00150.2166210.0001
Mysql Total
Database connection0.00060.087010.0006
Mysqli_queries0.618090.99071910.0032
Looping result0.00170.25161890.0000
Template Total0.657096.720.3285
Template load0.00190.277020.0009
Template processing0.655196.456220.3275
Template load and register function0.00010.017510.0001
states
state_id_array0.00080.116810.0008
state_identifier_array0.00060.094120.0003
Override
Cache load0.00160.2333200.0001
Sytem overhead
Fetch class attribute can translate value0.00090.130530.0003
Fetch class attribute name0.00090.131030.0003
XML
Image XML parsing0.00090.138030.0003
class_abstraction
Instantiating content class attribute0.00000.001230.0000
General
dbfile0.00300.4362260.0001
String conversion0.00000.000930.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/forum_topic.tplextension/sevenx/design/simple/override/templates/full/forum_topic.tplEdit templateOverride template
2content/datatype/view/ezxmltext.tpl<No override>extension/community_design/design/suncana/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
4content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
3content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
1content/datatype/view/ezimage.tpl<No override>extension/sevenx/design/simple/templates/content/datatype/view/ezimage.tplEdit templateOverride template
1content/datatype/view/ezxmltags/literal.tpl<No override>extension/community/design/standard/templates/content/datatype/view/ezxmltags/literal.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 13
 Number of unique templates used: 7

Time used to render debug report: 0.0002 secs