KolibriOS/kolibrios
15
21
Fork 36
Code Issues 129 Pull Requests 31 Actions 2 Projects 1 Releases Wiki Activity

[GSoC] Add initial libunicode parser and example #356

Open
codewithchill wants to merge 1 commits from codewithchill/kolibrios:libutf into main
pull from: codewithchill/kolibrios:libutf
merge into: KolibriOS:main
Conversation 0 Commits 1 Files Changed 2 +151
codewithchill commented 2026-03-09 07:40:58 +00:00
First-time contributor
Copy Link

Hi Ivan and team,

This PR introduces the initial setup for libunicode as part of my GSoC qualification task.

What is included:

  • /programs/develop/libraries/libunicode/libunicode.asm: Contains the core parsing logic.
    • count_utf8_codepoints: Counts raw Unicode values.
    • count_utf8_graphemes: Counts visual characters (includes logic to subtract counts for Zero-Width Joiners and basic combining marks).
  • /programs/develop/libraries/libunicode/examples/console.asm: A test application that passes a complex UTF-8 string to the functions and prints the results to the console.

I have tested this against standard ASCII, Russian text, complex ZWJ emojis, and accented characters.

I am looking forward to your feedback on KolibriOS code style, formatting, and best practices so I can update this to match the official OS standards!

Hi Ivan and team, This PR introduces the initial setup for `libunicode` as part of my GSoC qualification task. **What is included:** * `/programs/develop/libraries/libunicode/libunicode.asm`: Contains the core parsing logic. * `count_utf8_codepoints`: Counts raw Unicode values. * `count_utf8_graphemes`: Counts visual characters (includes logic to subtract counts for Zero-Width Joiners and basic combining marks). * `/programs/develop/libraries/libunicode/examples/console.asm`: A test application that passes a complex UTF-8 string to the functions and prints the results to the console. I have tested this against standard ASCII, Russian text, complex ZWJ emojis, and accented characters. I am looking forward to your feedback on KolibriOS code style, formatting, and best practices so I can update this to match the official OS standards!
codewithchill added 1 commit 2026-03-09 07:40:59 +00:00
Add initial libunicode for UTF-8 parsing and example
Some checks are pending
Build system / Check kernel codestyle (pull_request) Blocked by required conditions
Details
Build system / Build (pull_request) Blocked by required conditions
Details
6de88d5fd0 
- Added libunicode.asm to parse UTF-8 strings.
- Implemented count_utf8_codepoints to skip continuation bytes.
- Implemented count_utf8_graphemes to handle ZWJ (E2 80 8D) and combining marks (CC/CD).
- Added console.asm to the examples folder to test and print the results.
- Submitted for GSoC qualification task.
Some checks are pending
Build system / Check kernel codestyle (pull_request) Blocked by required conditions
Required
Details
Build system / Build (pull_request) Blocked by required conditions
Required
Details
This pull request doesn't have enough required approvals yet. 0 of 2 official approvals granted.
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u libutf:codewithchill-libutf
git checkout codewithchill-libutf
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
C
Category/Applications
Category/Drivers
Category/General
Category/Kernel
Category/Libraries
Eolite
FASM
FS
GSoC
This issue in GSoC program
 HardwareTested
HLL
Influence/Settings
Influence/Text/TYPO
IRCC
Kernel
Kind
Breaking
Breaking change that won't be backward compatible
Kind
Bug
Something is not working
Kind
Build
Kind
Documentation
Documentation changes
Kind
Enhancement
Improve existing functionality
Kind
Feature
New functionality
Kind
Security
This is security issue
Kind
Testing
Issue or pull request related to testing
Pay for the code
Paid task
PR
Conflicts
PR conflicts with main
PR
Dependent
This PR is dependent on another PR
Priority
Critical
The priority is critical
Priority
High
The priority is high
Priority
Low
The priority is low
Priority
Medium
The priority is medium
PR
Ready to merge
Pull request is ready for merge
PR
Request changes
Changes requested in pull request
PR
Review required
Reviewed
Confirmed
Issue has been confirmed
Reviewed
Duplicate
This issue or pull request already exists
Reviewed
Invalid
Invalid issue
Reviewed
Won't Fix
This issue won't be fixed
Status
Abandoned
Somebody has started to work on this but abandoned work
Status
Blocked
Something is blocking this issue or pull request
Status
Need More Info
Feedback is required to reproduce issue or to continue work
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
ace-dent Burer Doczom dunkaist IgorA Leency mxlgv ramenu rgimad sdongles Sweetbread
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: KolibriOS/kolibrios#356
Delete Branch "codewithchill/kolibrios:libutf"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?