This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 143747 - I18N - YAML editor could not handle file that contains Unicode characters.
Summary: I18N - YAML editor could not handle file that contains Unicode characters.
Status: VERIFIED FIXED
Alias: None
Product: ruby
Classification: Unclassified
Component: Editing (show other bugs)
Version: 6.x
Hardware: All All
: P3 blocker (vote)
Assignee: Torbjorn Norbye
URL:
Keywords: I18N
Depends on:
Blocks:
 
Reported: 2008-08-13 11:52 UTC by tkrd_oiax
Modified: 2008-10-13 19:29 UTC (History)
1 user (show)

See Also:
Issue Type: DEFECT
Exception Reporter:

Attachments
A YAML file that causes a ScannerException. (54 bytes, text/plain)
2008-08-13 11:53 UTC, tkrd_oiax 		Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description tkrd_oiax 2008-08-13 11:52:00 UTC 
YAML editor reports syntax error (ScannerException) against a correct file.

It seems that Unicode characters in it causes this problem.
See the file which I will attach later.

Might be related to the Exception 90286 which I reported recently.
Comment 1 tkrd_oiax 2008-08-13 11:53:43 UTC 
Created attachment 67244 [details]
A YAML file that causes a ScannerException.
Comment 2 Torbjorn Norbye 2008-08-29 18:45:07 UTC 
This works fine for me - but that might be because I just yesterday updated the YAML parser to the latest version
(changeset ae6cda6f80c9).  I added a unit test for your file (changeset 85634280a792).

Can you try a new build and verify that it works for you now? If not I'll have to dig deeper to find out why the file
fails for you and not for me (and if so, attach the ScannerException too.)

The latest builds are available here:
http://deadlock.netbeans.org/hudson/job/trunk/

Wait about two hours from now if you want to pick up the other fix I just checked in for issue 143746.
Comment 3 Torbjorn Norbye 2008-08-29 18:57:27 UTC 
I spoke too soon - this problem is still there. I will forward this issue to Ola (who wrote the YAML parser).
Comment 4 Ken Frank 2008-10-01 06:56:50 UTC 
can filer tell which locale or reg setting they are running netbeans in
and what the project encoding property is ?

ken.frank@sun.com
Comment 5 Torbjorn Norbye 2008-10-01 22:52:07 UTC 
Fixed in changeset 7e38a615eb26
Comment 6 Torbjorn Norbye 2008-10-02 00:25:00 UTC 
I discovered with a larger testcase (e.g. with text -after- the multibyte character(s)) that all of the YAML parser
offsets are byte offsets, not the unicode/document offsets we need! Thus the highlights etc. were all off.

I've fixed that now with integration a44448648373.
Comment 7 tkrd_oiax 2008-10-02 12:44:36 UTC 
Congratulations!
Comment 8 Ken Frank 2008-10-06 18:52:47 UTC 
to issue filer - does your last comment mean it can be verified as fixed ?

ken.frank@sun.com
Comment 9 tkrd_oiax 2008-10-07 12:03:25 UTC 
to kfrank:

Yeah, I think it has been fixed.
I'm sorry for my ambiguous comment.
Comment 10 Ken Frank 2008-10-13 19:29:50 UTC 
v