Should i convert my php files in my script from ANSI to UTF8 no mark?
I have really been struggling over this now for a few days. I have gone back and forth and back again. Advantages, disadvantages and back again.
It is what i consider a small to mid size script of 741 files with smarty occupying about 1/3 of those.
I keep telling myself if it works dont fix it.. But then again if i dont then i could be limiting my market.
Right now my tables are all latin1 swedish ci
I do set some of the files in the header to utf8 but my php files themselves are saved as ANSI.
One of my biggest objections is that if i dont do this correctly i could fall prey to the following which comes from the utf8 wiki.
A UTF-8 parser that is not compliant with current versions of the standard might accept a number of different pseudo-UTF-8 representations and convert them to the same Unicode output. This provides a way for information to leak past validation routines designed to process data in its eight-bit representation
I wish there was one question i could ask myself to know wether this was worth doing or not. The only thing i could come up with so far is:
"Is the script going to be available to foreign markets which would require this flexability" And my answer to that would be not as a major influence. But still it bothers me.
Any ideas from anyone of how you finally decided what to do if you have faced this challenge or what you would recommend.