My favorites | Sign in
Google
          
New issue | Search
for
| Advanced search | Search tips
Issue 2600: Problem in SMS with extended characters
34 people starred this issue and may be notified of changes. Back to list
Status:  Duplicate
Merged:  issue 2719
Owner:  ----
Closed:  Aug 21
Type-Defect
Priority-Medium
Version-1.5
Target-Donut
Component-System


Sign in to add a comment
 
Reported by zirrus, May 07, 2009
Firmware: 1.5
Kernel: 2.6.27-00392-g8312baf android-build@apa27 #72
Compilation Number: CRB17

This problem has been detected in a HTC Magic Vodafone (Spain)

The SMS application does not manage extended characters (accented chars, ñ
char and others) correctly. A extended character takes more space than a
normal character. 

Moreover, when a SMS contains extended characters, it is received
unreadable. The sms text looks normal and right on the source device but it
contains chunk characters (at signs, chinese chars, etc) when is received
in another device.



Comment 1 by fierro85, May 15, 2009
I Have the same problem.

The ñ char works fine, but the chars like (á, é, í, ó, ú) produces the SMS lenght
down to 60 characters.
Comment 2 by zirrus, May 17, 2009
I have been testing the problem.

When chars like á, é, í, ó, ú are used (ant other strange chars like º or ·), the
lenght of the SMS is shorted to 60 characters. If you do not exceed the 60 chars
limit, it is sent correctly. However, if you write more than 60 characters and use
several SMS fragments, the SMS is sent in a wrong way and only the first fragment is
received right. 

It seems to be a problem managing long sms (more than 1 fragment) with accented chars.
Comment 3 by fierro85, May 20, 2009
I think that the problems come by the encoding that the spanish telephone operators
uses to encode the SMS. It's possible that Android use UTF-8 (Unicode) and the
spanish operators need ISO-8859-1 or ISO-8859-15...
Comment 4 by fierro85, May 20, 2009
Searching i found that the standar codification for the SMS uses 7 bits. In this
alphabet it's included Ñ and the ñ but not the accents. So when we write an accent,
the telephone should change to UTF-8 or UTF-16 and the length of the SMS is reduced.
Comment 5 by davidmalo, May 26, 2009
There's something more related on this somehow... Virtual Keyboard doesn't include 
grave-accented vowels (à, è, etc.) when Locale is set to Spanish, so I assume this 
should also be considered
Comment 6 by gilwooden, Jun 10, 2009
I do not know the GSM alphabet encoding precisely but i do know that on all the other 
phones i had letters such as à é ç or ù at least where encoded with no problem in GSM 
alphabet : for exemple i used to be able to send a 160 char SMS containing the 
mentioned letter within one SMS only which i think means it was not UTF-8 or UTF-16 
encoded
Comment 7 by therealangelogiuffrida, Jul 19, 2009
I have the exact same problem running Cyanogen's build in Australia… only happens to a few random 
contacts though.

Please fix this!
Comment 8 by rolfkeller, Jul 26, 2009
I have the same issue: when SMS windows shows .../3 there is a good chance message
will be corrupted and chinese characters will be received by receiver. 

As long as SMS windows shows /1 or /2 (split over 1-2 SMS), message should not be
corrupted.

As soon as character like "ê" is inserted (e.g. french word grêle), I think Android
switches to another coding scheme that takes more space. Then SMS is split over
several SMS messages. Bug appears mostly when split over 3 SMS according to my tests.
Comment 10 by marfhak, Jul 27, 2009
Same problem with French language, HTC Magic, build CRC1.
It's quite annoying, because you don't know whether the message made it alright,
except if your receiver tells you.....
Also, i've been using ChompSMS lately (another sms app), and it seems like the
problem doesn't happen there (can someone confirm this?), so that would make it an
app problem, not an OS problem.

Thanks!
Comment 11 by oliver.bleiker, Aug 11, 2009
Hi, I have the same problem.... But unfortunately even with ChompSMS the problem is
the same.

Rgds,
Comment 12 by gguilbon, Aug 13, 2009
Same problem here : after inserting a character like 'ê' the sms split after 64
characters instead of 145 and everything after the 65th character is not readable
(squares instead of common chars)

My provider is SFR in France.
Comment 13 by powell.lukas, Aug 15, 2009
I have the same problem with Polish characters. 
Comment 14 by S.octet, Aug 15, 2009
Same problem with HTC Hero in France ( Provider : SFR France )
Comment 15 by gregory....@gmail.com, Aug 15, 2009
Same problem with HTC Hero and SFR in France

Anyone knows if there's a workaround using a third-party SMS application?

Thanks
Comment 16 by madko77, Aug 15, 2009
I use chompsms and handcentSMS they are able to correctly handle unicode characters
in SMS (I try on HTC Magic SFR).
Comment 17 by matticala, Aug 17, 2009
Same issue here.

HTC Magic (Vodafone)
firmware 1.5
kernel: 2.6.27-00393-g6607056

Steps to reproduce:
- Write a long SMS that gets converted to MMS. If you erase some characters to go 
back to SMS 
lenght boundaries the resulting text to the receiver is a mix of symbols.
Copy-Pasting the sent text (with the right lenght) gives an identical result.
If the receiver sends that corrupted sms back, on the android device those symbols 
appears like 
KANJI.

Other ways to have the same problem: using special characters like capital grave 
chars and 
others or using emotes from the UI menu.
Comment 18 by justjev, Aug 20, 2009
Exactly the same on HTC Hero (Poland)!
Comment 19 by jbq@google.com, Aug 20, 2009
Is this a duplicate of  issue 2719  or a separate issue?

If it's a separate issue, please provide:
-the network on which the SMS originates
-the network on which the SMS is received
-the exact phone model that has problems receiving those messages
Status: NeedsInfo
Cc: j...@google.com
Comment 20 by rolfkeller, Aug 21, 2009
Yes, seems to be a duplicate of 2719.

N.B. seems to have been fixed by my network operator (Sunrise). I was using an HTC Magic.

network origin: Sunrise, Switzerland
network received: Swisscom, Switzerland

Messages that were failing before are now working and I cannot reproduce the issue
with an HTC Magic or HTC Hero.

And I tried by using embedded SMS/MMS application or chompSMS and issue doesn't show
up anymore. I copied )copy & paste) the exact same  messages as before. 

Seems like the operator changed a configuration somewhere! Can someone help
understand what the operator could have changed?


Comment 21 by gilwooden, Aug 21, 2009
I agree, i think this is a duplicate of 2719
In 2719, in comments 25, 26 and 27, i explained one possible reason : it was about 
multi-part sms containing non-GSMAlphabet chars : the parts containing only 
GSMAlphabet will get a GSMAlphabet encoding tag in their header while the one 
containing non-GSMAlphabet chars will get a UTF16 encoding tag in heir header and 
this is not correct according to the GSM standards and most phone will decode all the 
parts using the encoding tag found in the header of the first SMS hence if the first 
tag was UTF16 then when decoding a message which is in fact GSMAlphabet then you end 
up with kanji and if the first tag was GSMAlpahbet, when you reach a UTF16 part, you 
end up with sqaures.
Comment 22 by zirrus, Aug 21, 2009
I think that the  issue 2719  is a duplicate of this one. This issue is older :).

I have the problem in this situations:

Network origin: Vodafone. Spain
Network received: Movistar and Vodafone. Spain.

My terminal is a HTC Magic (Vodafone).
Firmware: 1.5
Kernel version: 2.6.27-00393-g6607056san@sandroid#1
Compilation number: CRC1

As you can see, I have updated the kernel version (since my last post) but the
problem is still there.

Please, fix the issue and let me know if you need more information.

Thanks.
Comment 23 by zirrus, Aug 21, 2009
Oops, I forgot the exact phone model that receives the messages.

They were:
- Nokia 7310 Supernova
- Nokia 5310 XpressMusic
- Nokia 7373


Comment 24 by madko77, Aug 21, 2009
still the same problem here too:

From network SFR Vodafone France, on a HTC magic 1.5 CRC1
To network SFR Vodafone France, on a Nokia 5800 ExpressMusic
Comment 25 by jbq@google.com, Aug 21, 2009
Thanks for the extra information. At this point I will close this issue as a
duplicate of  issue 2719  (yes, indeed, this issue is older, but 2719 ended up with
more stars and got looked at first). At this point we believe that the issue is fixed
in donut.
Status: Duplicate
Labels: Version-1.5 Target-Donut
Mergedinto: 2719
Comment 26 by zirrus, Aug 21, 2009
Ok. Don't worry. Just kidding :)

Thank you very much.
Comment 27 by jbq@google.com, Aug 25, 2009
(No comment was entered for this change.)
Labels: Component-System
Comment 28 by jorgecascales, Aug 28, 2009
Same problem with HTC Hero in Spain with Orange...
Comment 29 by jbq@google.com, Aug 28, 2009
(No comment was entered for this change.)
Cc: -j...@google.com
Comment 30 by /h/moc.elgoog/jlapenna, Aug 31, 2009
 Issue 3227  has been merged into this issue.
Comment 31 by /h/moc.elgoog/jlapenna, Aug 31, 2009
 Issue 2936  has been merged into this issue.
Comment 32 by hugo.monteiro, Sep 21, 2009
I've the same problem with my HTC Magic

Network Operator: TMN (Portugal)
Comment 33 by juanjomedina75, Oct 02, 2009
I've the same problem with my HTC Hero
Network Operator: Orange (Spain)
Comment 34 by jmiguelrm1970, Oct 05, 2009
I've the same problem with my HTC Magic

Network Operator: TMN (Portugal)


Comment 35 by lorenzo.aliani, Nov 12, 2009
How resolve the problem ???  It' s Drammatic when some people receive the sms....
Comment 36 by massimoruiz, Nov 19, 2009
I have the same problem with HTC Magic with Donut in Italy.
Comment 37 by dangrp, Nov 28, 2009
Same problem with Android 1.6 Donut in a HTC Magic from Vodafone Spain.
Sign in to add a comment