utf-8 - unicode - PHPBuilder Forums

utf-8 - unicode

vinod

I am using IIS 5.0 /Win 2000/PHP/SQL Server 2000

My First HTML Page is as
<html>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">

<body>

My test2.php is as

<?php
$dbdsn="test";
$username="test";
$password="test";
$conn=odbc_connect($dbdsn,$username,$password);

$seldata ="insert into table1 values(" . $_POST['text1'] . ",N'" . $_POST['text2'] . "',N'" . $_POST['text3'] . "')";	

$res=odbc_do($conn,$seldata);

?>
</html>

Now Table1 structure is
Emp_no Numberic
emp_name nvarchar
emp_add nvarchar

if I store Unicode/UTF 8 data for ex. तकगद
& if I open Table I got following codes like
& # & some number 2340;

Is this Unicode? or ?

Pl. guide me.

goa103

No it's the HTML representation of your characters.

vinod

Dear GOa103,

Yes, I want to know more.
pl. guide me.

Thanks in advance

Vinod

goa103

<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">

Your should place the META tags in HEAD.

However I don't really see why it doesn't work, what's your DBMS ?

I use MySQL and here is a simple working example that allows you to insert UTF-8 texts in a MySQL DB using a simple form. It uses the following users MySQL table to store the texts :

users.sql

CREATE TABLE `users` (
  `id` int(11) NOT NULL auto_increment,
  `name` tinytext NOT NULL,
  PRIMARY KEY  (`id`)
) TYPE=MyISAM AUTO_INCREMENT=3 ;

index.php

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">

<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>Bonjour, Hello, ‚¨‚Í‚æ‚¤</title>
</head>
<body>

<form action="<?= basename ($_SERVER ['PHP_SELF']) ?>" method="post">
Text : <input type="text" name="text" />
<input type="submit" />  

</form>

<?php

if (isset ($_POST ['text']))
{
	$text = $_POST ['text'];

mysql_connect () or die ("can't mysql_connect");
mysql_select_db ("test_20311") or die ("can't mysql_select_db");
mysql_query ("INSERT INTO users (name) VALUES ('$text')") or die ("can't mysql_query");

?>
Text inserted in database : <?= $text ?>
<?php    	
}

?>

</body>
</html>

For example if you try to insert the following UTF-8 string :
Bonjour, Hello, おはよう

It will insert that text in the users table :
Bonjour, Hello, ãŠã¯ã‚ˆã†

As it displays the UTF-8 text correctly, it means the text inserted in the DB is correct too. UTF-8 everywhere 🙂.

Hope it helps.

vinod

I am using MS SQL-2000.

Now I have 2 questions in my mind.

If data is in unicode can I use this data in other applicaton other than browser?

secondly If I use ASP and set session("code_page")=65001 &
and store data in unicode and open table then I am able to see same data in table also.

I am trying this for Hindi Language.

Vinod

goa103

Hello,

I am using MS SQL-2000

The DBMS doesn't matter anyway as data are stored as this, except if you ask it to handle the data differently. For example with PHP/MySQL, you can specify that data handled by PHP are encoded... Like it can quote strings (POST/GET...).

If data is in unicode can I use this data in other applicaton other than browser?

As long as it supports UNICODE. For example you can just copy & paste a string from your browser to your favourite text processor. I still use Wordpad to handle some simple tasks, to check the integrity of my data for example. But you have to paste your text as UNICODE text and same your files in a proper format : UNICODE text file (Wordpad), OpenOffice Writer document, MS Office Word document...

secondly If I use ASP and set session("code_page")=65001 &

???
Sorry but I don't know what "code page=" mean. Don't forget that's it's a PHP forum.

I am trying this for Hindi Language.

Hindi ?
After ASP... Here comes Hindi ^{^.}

Where's the PHP part between MS SQL, ASP and Hindi ?

Remember that the data itself doesn't matter, data can be correctly displayed as long as :
- A proper font is used to display the data, Arial UNICODE for example... And other fonts that support UNICODE.
- The application that displays the text supports UNICODE (Wordpad, Text processors, Web browsers like Mozilla or MS Internet Explorer)
- The data is stored as this, UTF-8, Shift-JIS... And a proper charset is used, you can force the charset from your web browser to compare what you can get, for example the string "étonné" is correctly displayed using ISO-8859-1 (Windows default on my french OS), the string "‚à‚µ‚à‚µ" is correctly displayed using Shift-JIS (or equivalent) but these strings are not correctly displayed using the UTF-8 charset because the page I use to write that message is not UTF-8 compliant ! I check and its charset is not even specified which means the text is stored as this, no UTF-8, no nothing so I have to force the charset for my web browser to display the texts correctly.

Hope it helps.

goa103

note : as I use Mozilla Firebird (pretty cool and damn powerful web browser), it automatically detects that the page contains Japanese so it switches to Shift-JIS charset to display the page.

vinod

Hello,

quote:

The DBMS doesn't matter anyway as data are stored as this, except if you ask it to handle the data differently. For example with PHP/MySQL, you can specify that data handled by PHP are encoded... Like it can quote strings (POST/GET...).

If you want to store UNicode Data in SQL-server 2000 then while inserting data it should be prefix with 'N'. & you have to use Nvarchar,Ntext etc as a Data type.

quote:

As long as it supports UNICODE. For example you can just copy & paste a string from your browser to your favourite text processor. I still use Wordpad to handle some simple tasks, to check the integrity of my data for example. But you have to paste your text as UNICODE text and same your files in a proper format : UNICODE text file (Wordpad), OpenOffice Writer document, MS Office Word document...

If I cut & paste a string from browser to text processer then it will display the same string, but what about the data which is being inserted in table if I cut data from table & paste it in text processer, I won't get same data.

That's why I am in troble?
Now I want to use Crystal Report 9.0 which support Unicode.
The data which i stored by using PHP, i am able to display but same thing I can do with ASP.

Now if I am typing "ककककककक" in browser & stroring it in MSSQL. & If I open table I get "à¤•à¤•à¤•à¤•à¤•à¤•à¤•"
IS it UNICODE?

pl. help me.
😕

goa103

IS it UNICODE?

Yes because the string is correctly display when I force my browser to UTF-8. Can't you try with your own browser ?

About UNICODE & MS SQL, I think you should post on a MS SQL forum. I didn't know MS SQL and thought you wouldn't need any special type like Nvarchar...

vinod

IS it UNICODE?

Yes because the string is correctly display when I force my browser to UTF-8. Can't you try with your own browser ?

Yes I know in browser the string is displayed correctly, But Data is in UTF-8 not in unicode. If I don't want to use browser , Can I Use this Data? No, Because in brower only i can see this data .

If I stored Unicode data then I can see/used this data in any other software development tool.

If you paste this Data in Notepad you can't see proper data.

About UNICODE & MS SQL, I think you should post on a MS SQL forum. I didn't know MS SQL and thought you wouldn't need any special type like Nvarchar...

Yes For MSSQL you have to use Nvarchar data type.

goa103

First you should understand that you can't encode a string to UNICODE, UNICODE is not a charset, UTF-8 like Shift-JIS or ISO-8859-1 are charsets. Notepad can't display the UTF-8 strings properly because you can't select a UTF-8/UNICODE compatible font like Arial Unicode (MS), Mincho & Cie. But it works with Wordpad because it allows you to select the font. So the way you store doesn't matter as long as you can display them correctly. These are only bytes you store you know, not UTF-8 strings. So output matters.