Talk:Emoji/Archive 1

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search
Archive 1 Archive 2 →

Unifying filenames

I’m making a template on fr.wikipedia to insert emojis in discussion pages. A parameter allows to choose the emoji theme. One of the problem I’m encountering is that each set has a different naming system. For instance:

U+263A Emoji u263a.svg Twemoji 263a.svg Emojione 263A.svg PEO-white smiling face.svg

Even without considering that specific template use, I think it would be better to have all them uniformly named on Commons. For instance, they could all follow a naming scheme like Emoji <Name of the set> <Unicode number>.svg with the Unicode number in a determined format, like lowercase without the ‘u’. So we would have:

U+263A Emoji Noto 263a.svg Emoji Twitter 263a.svg Emoji One 263a.svg Emoji Phantom 263a.svg

I believe it would make them simpler to use accross Wikimedia projects!
~ nicolas (talk) 18:41, 31 March 2015 (UTC)

@Ebraminio: ping!
Mentioned on Commons:Village_pump#Unifying_emojis_filenames Commons:Village_pump/Archive/2015/03#Unifying_emojis_filenames
(edit conflict) Hi! Your ping didn't notify me because signature was not on the same edit with the ping and I accidentally saw this. Right now I am busy with other things and can not do that by my own I suggest notifying the community here. Here is some notes that I think would be useful for the move, the current file names are after their original file names on their projects and that was because I thought that would make their update and maintenance easier (which now I don't think that matter much or this helps much), some were using lowercase and some uppercase for digits greater than 9, and some of Emojis of Category:Phantom Open Emoji are not listed on the table, I misspelled POE with PEO and please note that Phantom Opem Emoji is no longer is free, I uploaded free files remained from a fork happened on the time that POE was free, and they probably like that we don't use their name for the files uploaded from their fork, one of Google Emoji files are not on the table and please be careful about two parted file names that have different naming across the project, 1 with 2 and 3. −ebraminiotalk 21:06, 31 March 2015 (UTC)
Thanks for all the details! I’ll be very careful before doing this. By the way, I found a way to not be bothered by different naming systems on the template I was making: fr:Modèle:Emoji. Also, I don’t know what to do for Phantom’s name. ~ nicolas (talk) 22:29, 31 March 2015 (UTC)
Here is data provided from POE project to indicate which is which that, some are multiple frames from an animation and are not single frame and some are not Emoji even, like GitHub logo animation (which I think the GitHub logo copyright is not OK for Commons even). POE was first and oldest attempt to provide free Emojis so it probably not unexpected to see such wierdnesses because I think even they didn't know what they wanted ☺ −ebraminiotalk 01:16, 1 April 2015 (UTC)
This can easily be performed by mass-renaming via the category if anyone wants. I can easily perform the move, as long as I had a clear before and after naming thing to go by. Kevin Rutherford (talk) 23:23, 1 April 2015 (UTC)

Firefox Emoji

Mozilla released their own Emoji set: fxemoji. Depending on the license (I believe it was not made clear yet), it could be uploaded here as well. For now it supports Unicode 6 Emoji, but plans to support 7 and 8 Emoji in the near future. ~ nicolas (talk) 08:21, 1 October 2015 (UTC)

The license is CC-BYref: we can add them to Commons collection! ~ nicolas (talk) 08:38, 6 October 2015 (UTC)
~ nicolas: Thanks for finding another Emoji collection! :) I just uploaded them, Category:Firefox OS Emoji. Unfortunately I can not keep these updated forever but I would try to be helpful sometimes :) −ebrahimtalk 21:31, 27 October 2015 (UTC)
Thank you a lot @Ebrahim, great to see them all here! ~ nicolas (talk) 11:47, 29 October 2015 (UTC)

New version of Emoji One

Also, a new version of Emoji One (nicknamed “2016 collection”) is going to be released in November. They announce more than 1000 new drawings, which I believe are part redesigns of existing ones, and part Unicode 8 new symbols. I wonder what’s the best way to manage them on Commons: it would be a pity to replace the superseded ones, but a mess if we upload only a part of the new ones like a different set.

Here are our options I think. Let’s say we have a Sad emoji which hasn’t be redesigned, a Smile emoji which has, and a Happy one which is new. File names aren’t right, they’re just for the principle.

Option 1

We upload all the new Emoji. The ones that replace existing ones get suffixed.

Emoji One Emoji One “2016”
Sad.svg N/A
Smile.svg Smile 2016.svg
N/A Happy.svg

Option 2

We upload all the new Emoji. They are all suffixed.

Emoji One Emoji One “2016”
Sad.svg N/A
Smile.svg Smile 2016.svg
N/A Happy 2016.svg

Option 3

We upload all the new Emoji. That time, the old ones that are replaced are renamed to be suffixed. The advantage is that we have the whole updated set under one naming, but we can still easily access and insert the former ones.

Emoji One 2014 Emoji One
N/A Sad.svg
Smile 2014.svg Smile.svg
N/A Happy.svg

Option 4

We upload the new Emoji, replacing the old ones. Previous drawings are only accessible in file history.

Emoji One
Sad.svg
Smile.svg
Happy.svg

Option 5

We upload everything again. The new collection is like a new set, even if some files are the same than existing ones.

Emoji One 2014 Emoji One “2016”
Sad.svg Sad 2016.svg
Smile.svg Smile 2016.svg
N/A Happy 2016.svg

What do you think? ~ nicolas (talk) 09:06, 6 October 2015 (UTC)

~ nicolas For sake of simplicity and having more free works thus more choices on Commons I probably go with last one if that would be OK :) −ebrahimtalk 08:03, 12 November 2015 (UTC)
Ebrahim: Yes, option 5 is good and practical! I just hope it’s okay to have duplicates. ~ nicolas (talk) 21:09, 14 November 2015 (UTC)
Emoji One 2016 is now out! It notably includes skin tones. http://emojione.com/demo ~ nicolas (talk) 10:04, 18 December 2015 (UTC)
It seems that User:DimaLeon2000 has uploaded the new set using option 4. ~ nicolas (talk) 20:35, 17 January 2016 (UTC)
~ nicolas: I also followed updating the rest with option 4 with the last free SVG version (2.2.7) −ebrahimtalk 22:09, 14 June 2017 (UTC)
~ nicolas: lots of missing ones are also updated on the different projects. −ebrahimtalk 22:21, 14 June 2017 (UTC)
~ nicolas: I guess you will be interested on old version of Category:Emoji_One_v1, for sake of "archivist"ism :) −ebrahimtalk 22:01, 18 June 2017 (UTC)
Cool, good idea! In that case, I would suffix the other one as v2 too, so it’s clear that it isn’t the latest one and that we are not distributing v3. So our rule is something like: we are collecting as separate sets every upgrade that introduces major design changes (often primary version numbers or new branches), otherwise we just update the files… it makes sense! To consider for upload: the original Android Emoji monochrome set (Apache license). With the new one coming up, we’ll have three generations of Google’s emoji! ~ nicolas (talk) 16:41, 19 June 2017 (UTC)
That is what I thought also :) This is its latest version, interesting that I wrote some code for converting glyphs of a ttf file to svg files in the past here (and interesting that I am not mentioned there at all there 😀), lets see how this goes... −ebrahimtalk 17:31, 19 June 2017 (UTC)
But the version you've indicated is importable on fonttools, hmmm −ebrahimtalk 17:40, 19 June 2017 (UTC)
Used fontforge python library but fonttools was ok on later tests, all uploaded anyway and extract/upload/table-update codes are available on Talk:Emoji/code. −ebrahimtalk 21:35, 19 June 2017 (UTC)

EmojiOne 3

Just a reminder to not upgrade to EmojiOne 3, which is no longer under a free license. ~ nicolas (talk) 10:11, 22 April 2017 (UTC)

Sad but thanks for the information −ebrahimtalk 22:21, 14 June 2017 (UTC)

Noto Color Emoji (Android O)

Android’s Emoji have been entirely redesigned from scratch (see [1]). Once Android O goes out of beta, we should upload them here, separately from the currently existing set. ~ nicolas (talk) 16:15, 18 May 2017 (UTC)

~ nicolas: What do you suggest when they are released, option 4, option 5? I think blobs design were that unpopular that if we replace all of them with the new ones, no one is going to miss them, but Commons preference is usually on a separate names. The table available on this page is hard to update as the number of newly introduced Emojis, perhaps someone should create separate page for them or I don't know −ebrahimtalk 22:17, 14 June 2017 (UTC)
Hi! I would think the best is option 5, since it's actually an entire new set designed from scratch, even though it share the same maker with the previous one. Nothing links them in terms of style, so I strongly prefer we treat them as something new all together. Let's see if they are also released as part of the Noto project, in which case we can just add a branch version number or rename the previous one if necessary? As for the table on this page, that's something to think about indeed. Even in the case it keeps this form, it should be updated to Unicode 10/Emoji 5. Maybe we can loose some info and not try to be on par with Unicode's own tables, and do something more gallery-like than table-like, with a cell for each emoji (with a caption) and all the designs for it in the cell? Let's think about all this. ~ nicolas (talk) 10:51, 15 June 2017 (UTC)
It is now time to add the emoji. The option 5 will definetely be the option to choose, since the differences are so substantual. 86.22.8.235 21:25, 21 August 2017 (UTC)
Yes, the files are not on the Noto repository yet, but it should happen any day now ~ nicolas (talk) 14:26, 25 August 2017 (UTC)
The files are online! ~ nicolas (talk) 06:24, 26 August 2017 (UTC)

Twemoji 2.3

While we're at it, we should also update Twemoji to the latest version, 2.3, which has full support for Unicode 10/Emoji 5! Latest SVGs. ~ nicolas (talk) 14:55, 15 June 2017 (UTC)

~ nicolas: Thanks! Category:Twemoji v2 −ebrahimtalk 22:47, 15 June 2017 (UTC)
Neat! Thank you for uploading! ~ nicolas (talk)
Thinking about it, I wonder if Option 4 wasn’t more relevant than Option 5 for this one, since it’s just an update without major changes in art direction, just a normal evolution? ~ nicolas (talk) 17:50, 18 June 2017 (UTC)
Yes, I feel the same also, hadn't chance to compare two sets before the upload but don't know why they chose a different version for that, perhaps we can move that them sometime or I don't know −ebrahimtalk 21:33, 19 June 2017 (UTC)

Emoji list

Hello,

So I give it some thoughts, and I think this is the right way to do the list: we maintain a data table in JSON (mw:Help:Tabular_Data) in a separate Data:Emoji.tab entry. All emoji characters, with their Unicode code points, their name, and their keywords. The list can be generated from the Unicode Emoji List ([2]) and/or the Unicode Annotation Charts ([3]+[4]). So we have one single repository for all this info, accessible from all Wikimedia projects.

Then, we can use the data to generate (either dynamically or once in a while): the Emoji gallery on Commons (whether it keeps this form or get another one), the descriptions (and categories?) for each Emoji file (which are not very helpful now individually), the lists for the local en:Template:Emoji templates on various wikis, possible en:List of Emoji articles and such, etc.

The file can look something like this:

Initial JSON test
{
	"license": "CC0-1.0",
	"description": {
		"en": "List of emoji characters."
	},
	"sources": "Reference: [http://www.unicode.org/emoji/charts/emoji-list.html Unicode Emoji List v5.0] and [http://unicode.org/cldr/charts/dev/annotations/ Unicode Annotation Charts]",
	"schema": {.svg
		"fields": [
			{ "name": "code", "type": "string", "title": { "en": "Code point(s)" } },
			{ "name": "name", "type": "localized", "title": { "en": "CLDR short name" } },
			{ "name": "keys", "type": "localized", "title": { "en": "Other keywords" } }
		]
	},
	"data": [
		[{
			"code": "1F600",
			"name": { "en": "grinning face" },
			"keys": { "en": "face | grin" }
		}],
		[{
			"code": "1F601",
			"name": { "en": "beaming face with smiling eyes" },
			"keys": { "en": "eye | face | grin | smile" }
		}]
	]
}

Names and keywords are available in many languages in the Unicode Annotation Charts folder, so we can really get a nice data file for many uses! Open questions: do we need a char field containing the raw Unicode character(s) (so we have an easy access to it and it displays in the tabular preview)? Should the code field have the U+ prefix? Is a space okay as a separator for multiple code points? Is a pipe okay as a separator for keywords? (a formatting use by Unicode but is it parseable by MediaWiki templates/script?) Do we need a separate data table to maintain a list of each code point availability in different Emoji sets?

I really feels Commons can be the definite repository for freely licensed Emoji sets!

~ nicolas (talk) 07:40, 17 June 2017 (UTC)

I created a sample/initial version of Data:Emoji.tab with three emoji as a test. Once the format is set, I think we can focus on generating a Emoji 5 data set from [5], in English only first, and try out what can be done from there. ~ nicolas (talk) 08:05, 17 June 2017 (UTC)
Update: got the full list imported: Data:Emoji.tab. I didn’t thought I would be able to do it myself but it was super easy to get with regular expressions! (kept at Data talk:Emoji.tab)
Things to consider about the current state of formatting, if it need changing before using the data: multi code points are separated with underscores (which is actually nice enough I think?), keywords by spaces and pipes.
It would be good, and would simplify a lot of things, if the chosen syntax for the code points is somehow reflected in the file names. So for instance, “flag for United Kingdom” would be File:Emoji Noto 1f1ec_1f1e7.svg / File:Emoji Twemoji2 1f1ec_1f1e7.svg / File:Emoji EmojiOne 1f1ec_1f1e7.svg instead of File:Emoji u1f1ec 1f1e7.svg / File:Twemoji2 1f1ec-1f1e7.svg / File:Emojione 1F1EC-1F1E7.svg. Back to my first message on this page 🙂 Is it easy to mass rename files?
Next, I’ll try to find out how to: do a new version of en:Template:Emoji using the data, get it on Commons so we can insert Emoji files from various sets super easily, re-generate Commons’ Emoji table using that new data and that inserting template, see what can be done to update the descriptions of the Emoji files (probably a template using PAGENAME to find the corresponding data and added using subst: so that the content is part of the file page itself?). I may need some help for some of these! 😉 ~ nicolas (talk) 11:57, 17 June 2017 (UTC)
~ nicolas: Great! I guess you will find this interesting Module:Emoji that uses your data and User:Ebrahim/sandbox can be created from it. It is limited to 100 as it full version doesn't work −ebrahimtalk 21:57, 17 June 2017 (UTC)
Ha nice! I played (and will play again) a bit with this, never done any Lua yet, but with a bit of trial and error I seem to be getting somewhere. I’m trying to reimplement an improved version of the inserting part of the original template, so that we can use it both in the table to insert emojis and in a new emoji insertion template that would essentially just be a wrapper for this function. By the way, is it possible to access modules functions from other wikis (like data, unlike templates)? ~ nicolas (talk) 11:45, 18 June 2017 (UTC)
Not yet AFAIK, this has POE file names, or perhaps we should rename them once and for all. −ebrahimtalk 16:19, 18 June 2017 (UTC)
Yes yes yes for renaming. Everything should be named similarly. Unrelated: do you know how in Lua we access data on the same line of a table? Like getting the emoji name from the emoji unicode, or getting the emoji unicode from the raw emoji, etc. ~ nicolas (talk) 16:30, 18 June 2017 (UTC)
~ nicolas: I guess you should search that object (checking every entry with your condition and picking the one you want, or more complicated algorithm like binary tree search). Your triple "yes" motivated me to do that :) what naming scheme do you prefer? I am going for Noto. −ebrahimtalk 17:04, 18 June 2017 (UTC)
One of them, let me know if like to apply this to the rest. −ebrahimtalk 17:31, 18 June 2017 (UTC)
I would put “Phantom Open Emoji” in full otherwise the file name is really abstract! Lowercase code is good! Then “u” or not “u”, I don’t mind, but it would be nice to choose one format once and for all and apply it to everything… I’m not sure if “u” is that standard, I think I see “U+” more often? Maybe we can remove the prefix all together and go for a simpler code only naming? Then there’s the question of the separator between multiple code points (space, underscore, or hyphen) but that’s probably not applicable to Phantom. ~ nicolas (talk) 17:42, 18 June 2017 (UTC)
All done :) −ebrahimtalk 18:21, 18 June 2017 (UTC)
~ nicolas: User:Ebrahim/emojitableupdate.py here is the Emoji page updater code I just wrote, I've ran that just right now but feel free to do that anytime you want with your improvements :) −ebrahimtalk 19:56, 18 June 2017 (UTC)
Ah nice, so we’re doing this offline in Python from time to time instead of online in real time in Lua! That’ll avoid the “expensive” and “time out” messages! :) Should we move the script as a subpage of Emoji so it’s easy to find and update? (or is there a thing against scripts in the general namespace?) I’ll try to set up the Python thing so I can generate other lists like the en:Template:Emoji/Gallery palette. I guess we can also remove the table function in the module, since it won’t be used? Exciting work this week-end, tool-making for emoji archivists :) ~ nicolas (talk) 20:09, 18 June 2017 (UTC)
~ nicolas: Emoji/update.py, agreed :) −ebrahimtalk 20:49, 18 June 2017 (UTC)
Good! Last thing: should the table be moved to a subpage (Emoji/Table?) too, and included in the main page? So we can have a safe space to write the page heading description, maybe a short presentation of the themes available on Commons (and which version are the latest here), etc, without messing with the table my mistake or getting it overwritten :) ~ nicolas (talk) 20:56, 18 June 2017 (UTC)
Done! Emoji/Table −ebrahimtalk 21:00, 18 June 2017 (UTC)
With more and more emoji sets and the list growing out some screens, proposition of little changes for the table : User:Nclm/EmojiTest3&oldid=248388246. For the size : emoji are now 48px wide instead of 64px, name and keywords now share the same column. Other changes: emoji are centred both horizontally and vertically in their cells, name and keywords are moved to the left so after the three introductory columns it’s all and only about emojis, initial # cells are now headings, new order trying to balance ante-chronological order with state of completeness ordering with grouping by vendors with prioritising on the left the sets that are still active, and use of {{N/a}} for the missing emojis so it’s clear that empty cells are not a mistake but a deliberate showing of the state of the collection. ~ nicolas (talk) 19:24, 19 June 2017 (UTC)
Done! N/A was a bit hard to have, feel free to try that by your own :) −ebrahimtalk 20:38, 19 June 2017 (UTC)
Nice! What about using the model directly? (without or with subst:) ~ nicolas (talk) 20:56, 19 June 2017 (UTC)
That template contains a table in itself and that would be very expensive for the page I guess. −ebrahimtalk 21:22, 19 June 2017 (UTC)

Want even further expansion?

There are many differences between the B&W Android, Android L and Android N emojis. JuTa made a small contribution but I prefer to retrieve all of the emoji of Noto prior to Nougat. You can choose for yourself to retrieve Lollipop or both KitKat and Marshmallow, whatever you want.

But less importantly, if iOS 9.3 & 10.3 emoji, Microsoft Windows 8.1 and 10 emoji and Samsung emoji is possible for Wikipedia to use? They seem to be major emoji vendors, but if not, can you please tell us why. If you do, I will update the en:Template:Emoji. 86.22.8.235 22:07, 19 August 2017 (UTC)

Yes, the idea for every set in the medium term is to have a separate copy of every version which introduced major breaking design changes, so Android emoji are not going to be one single set. As for Apple, Microsoft, and Samsung emoji, they simply can not be hosted and used on Wikimedia projects: they are proprietary and Commons only collects freely-licensed work. ~ nicolas (talk) 16:46, 20 August 2017 (UTC)
From Emojipedia: As such, those wanting to use Apple’s (and the other platforms I mentioned, same is true for Facebook and EmojiOne 3) emoji images may be restricted to using these images in a way that could be considered fair use. And also, the licensing is not publicly available. Because of this, we have our Emoji (as Native) column and the same embedded onto the emoji template. So theoretically, these images can be used if you have the device that uses it. Fair Use could be used, but Emoji are SGV-based and I think that non-free SGV files are not permitted. 86.22.8.235 10:04, 21 August 2017 (UTC)
Fair use as a justification to upload proprietary designs could maybe be used on the English Wikipedia, but definitely not on Commons. And only to upload some of them, not all of them: I'm afraid you can't justify uploading 2000+ files (times the number of sets) under fair use. A representative sample of two or three symbols to illustrate en:Emoji perhaps, but probably not a lot more. ~ nicolas (talk) 14:36, 25 August 2017 (UTC)

Noto Emoji versions and naming scheme

So, it is also time to upload the new version of Noto Emoji, but also to think about the reupload of old versions. According to Emojipedia, the major versions are the one released along with Android 4.3, Android 4.4, Android 5.0, Android 7.0, and Android 8.0. We have the 4.3 one (e.g. File:Android Emoji 1f628.svg) and 7.0 (e.g File:Emoji u1f628.svg), and soon 8.0. As for 4.4 and 5.0, they are often in file history, but not as independent sets. We should probably decide on how to name the different versions, since Noto itself doesn’t seem to follow a specific versioning (I may be wrong). We could go either with Android versions, Android names, or Android letters I think:

Also, should we rename File:Android Emoji 1f628.svg to File:Android B&W Emoji 1f628.svg, File:Android 4.3 Emoji 1f628.svg, File:Android Jelly Bean Emoji 1f628.svg, or File:Android J Emoji 1f628.svg so that it doesn’t sound like the current version? (I’m not sure every version were codenamed by their letters though) What do you think? ~ nicolas (talk) 06:49, 26 August 2017 (UTC)

~ nicolas: I am uploading with your second option for Oreo update as it is more descriptive, and this is the first upload: File:Noto Emoji Oreo 262e.svg, not sure about previous uploaded images, more manual job needed for uploading Emoji set of each release AFAICS and renaming old images can be somehow risky (but feel free to suggest rename on the just uploaded sets). −ebrahimtalk 08:53, 26 August 2017 (UTC)
~ nicolas: Also I am considering noto-oreo name for the set, [6]. The other option I thought about was using noto-old or noto-nougat for old set and using noto for the latest set, which one do you see more suitable? Feel free propose any suggestion. −ebrahimtalk 09:14, 26 August 2017 (UTC)
All uploaded: Category:Noto Color Emoji Oreo but it seems not all are available on the table, maybe Data:Emoji.tab is outdated? −ebrahimtalk 11:13, 26 August 2017 (UTC)
Nice, thanks for the work! The data file will be up to date to the spec until next year’s Unicode release… But it’s possible that Noto has non-standard but nice to have multi-codepoints emojis, like families with skin colours or such. Is it possible to make a list of all Emoji in a set but not in our data? ~ nicolas (talk) 13:29, 26 August 2017 (UTC)
~ nicolas: Good idea! Done. First ones are expected AFAICT but some not really AFAIK. −ebrahimtalk 19:41, 26 August 2017 (UTC)
Also Talk:Emoji/Not used Noto Emoji Oreo here so we can have a better look, WDYT? −ebrahimtalk 19:52, 26 August 2017 (UTC)
Perfect! Ok, so it’s just something about fe0f, they don’t put it in their filename. We need something like the keycaps exception you put in the script, but for all of this set! Then will only (I think) remain numbers, letters and skin tones patches, but there are not emoji as such, just constituents which happen to have a picture for future retro-compatibility… ~ nicolas (talk) 21:12, 26 August 2017 (UTC)
~ nicolas: Excellent! Applied that on both old noto and noto-oreo and ~1000 images added to the table (had no or reverse effect on the rest of sets), only these now remain Talk:Emoji/Not used Noto Emoji Oreo which seems expected (except wrestling and hand-shaking?). Thanks −ebrahimtalk 10:16, 27 August 2017 (UTC)
We have 8.0 done but what about the 4.4 and 5.0? Can we go with these or are we concerned about Special:LongPages and page lag? I really missed those and I want to use these again. 86.22.8.235 09:29, 28 August 2017 (UTC)
Thanks for the insterest! :) Personally I don't have concern for that as it always was laggy to load (as the same unicode.org page that had all of the Emoji and was laggy as well). Unfortunately, on the noto project itself, they are not that distinguishable from the rest of design. So, if you can, by making a GitHub issue, ask them to separate (tag) their old versions from the newer designs, or filter and find the older designs on history of that repository and upload it to Commons, or find the revisions you believe have those different design so we can upload them maybe sometime. −ebrahimtalk 16:12, 28 August 2017 (UTC)
I managed to find it even I don't have a GitHub account. For Android 5.0: https://github.com/googlei18n/noto-emoji/tree/11868c62b70b6b1184053dcf2f58246b20503b74/svg and for Android 4.4: https://github.com/googlei18n/noto-emoji/tree/bf295c4580e51ae98b9ed4399bbf72a31c1cc525/svg . 86.22.8.235 21:31, 28 August 2017 (UTC)
Thanks! Done Category:Noto Color Emoji KitKat and Category:Noto Color Emoji Lollipop (contains the only changed ones). −ebrahimtalk 08:39, 29 August 2017 (UTC)
Thanks but I also want them at Emoji/Table because many people don't know they exist. 86.22.8.235 11:26, 29 August 2017 (UTC)
What can go wrong? :) Done −ebrahimtalk 11:32, 30 August 2017 (UTC)
Also if someone interested on splitting the table, please bring your suggestions here and have a look at the update code here, you can do that by yourself (with minimum effort) if you are familiar with python but please update the code so others could run yours later. −ebrahimtalk 11:39, 30 August 2017 (UTC)
LOG: I was asked here to make redirects for not updated Lollipop emojis to their KitKat counterparts. −ebrahimtalk 16:12, 30 August 2017 (UTC)

Emoji 11.0

The final Emoji 11.0 has been released! I updated Data:Emoji.tab, let’s now keep an eye on the emoji sets for when they release design updates. ~ nicolas (talk) 16:44, 18 February 2018 (UTC)

Hi Nclm,
Do you intend to update the list to Unicode Emoji List v12.0? Thomas Linard (talk) 10:57, 6 February 2019 (UTC)
Hi, yes I will at one point! The issue is that the source table now separates skin colours variations away from the main list, so I'll have to find a way to merge both data in a way that makes sense. ~ nicolas (talk) 13:44, 6 February 2019 (UTC)
Hi Nclm. And we'll have much more color variations in the future. According to Emojipedia Blog, "With Emoji 12.0, every shape (squares, circles and hearts) will have the choice of the following colors: […] These new colors […] pave the way for custom emoji colors, if used within ZWJ Sequences." Thomas Linard (talk) 00:44, 10 February 2019 (UTC)
Hi Nclm, Twemoji 12.0 is almost here, could you update Data:Emoji.tab to Emoji 12.0 ? Many thanks! Thomas Linard (talk) 13:21, 4 April 2019 (UTC)
Here you go: Data:Emoji/List.tab and Data:Emoji/Modifiers.tab :) The first one got generated from the first Unicode table, but I’m somehow missing 7 emoji, and I don’t know which ones or why :/ The second one is still empty, I have to figure out how to read the other Unicode table. I think we s ould follow Unicode and create two tables, it will be easier to maintain and to count the entries than merging them. The code in Talk:Emoji/code has to be updated to use Data:Emoji/List.tab instead of Data:Emoji.tab (I moved the list), and when Data:Emoji/Modifiers.tab is ready, to generate a second table. ~ nicolas (talk) 19:48, 4 April 2019 (UTC)
Many thanks! I updated Talk:Emoji/code. Thomas Linard (talk) 04:10, 5 April 2019 (UTC)
OK, I updated Emoji/Table with Talk:Emoji/code (for Twemoji v12). So far, so good. We need Data:Emoji/Modifiers.tab now. 😀 Thomas Linard (talk) 22:01, 5 April 2019 (UTC)

Streamline Emoji

A new, CC-by-licensed, emoji set: Streamline Emoji. “Only” 788 icons for now, with SVG files that are not matched to Unicode points and also not compatible with librsvg. But a very promising project! They plan to “create ALL the emoji listed in the Unicode 11.0 version”, so let’s see! ~ Nicolas (talk) 15:41, 7 April 2018 (UTC)

Uploaded two of them File:001-grinning-face.svg File:002-beaming-face-with-smiling-eyes.svg, librsvg bug as you mentioned, only half of them can have an actual
import pywikibot, json
commons = pywikibot.Site('commons', 'commons')
emoji_data = json.loads(pywikibot.Page(commons, 'Data:Emoji.tab').text)
emoji_dict = {x[2]['en']: x[1] for x in emoji_data['data']}
[emoji_dict.get(' '.join(x.split('-')[1:-1])) for x in sorted(os.listdir('.')) if x.endswith('.svg')]
So not sure what do with them for now. And I see you have filed them as bug for them, I subscribed myself to them :) −ebrahimtalk 12:07, 27 April 2018 (UTC)
Yes, let’s follow this, see what it becomes :) ~ Nicolas (talk) 12:32, 27 April 2018 (UTC)
User:Nclm: Re-uploaded with your suggested fix but still doesn't work on MediaWiki. File:001-grinning-face.svg File:002-beaming-face-with-smiling-eyes.svg Can you try that also? Maybe Wikimedia's librsvg is outdated? −ebrahimtalk 11:25, 28 April 2018 (UTC)
Ah weird, it makes it work on Gnome, which as far as I know use librsvg too. I tried wrapping with a CDATA tag too, but it’s not better. My only experience with a similar bug was with File:Kentucky_Route_Zero_Map.svg, which was corrected with the MIME fix. ~ Nicolas (talk) 12:02, 28 April 2018 (UTC)
User:Nclm: Filed T193352 but I am uploading the version linked directly from the site which apparently supports librsvg already! I know it was more nice to have them with normalized names but lets have as its current form as an archive at least :) −ebrahimtalk 18:35, 29 April 2018 (UTC)

Most used Emojis

Have a look Talk:Emoji/query :) −ebrahimtalk 19:04, 29 April 2018 (UTC)

Neat, it’s interesting, thanks for that! :) ~ nicolas (talk) 15:53, 21 May 2018 (UTC)

OpenMoji

Another one, another one! OpenMoji is designed by German students, licensed under CC BY-SA 4.0, available both as a colour set and a monochrome set, has ~1200 symbols so far, and is open to contributions. It could be nice to upload it in its current state and add it to the table! ~ Nicolas (talk) 15:52, 21 May 2018 (UTC)

Nice! Category:OpenMoji Color and Category:OpenMoji Black :) −ebrahimtalk 19:23, 24 May 2018 (UTC)

Flamingoroo

OpenMoji The row 1f998 kangaroo has OpenMoji pics of flamingo. Code point for flamingo is not assigned yet [7]. Valid codepont for flamingo is 1F9A9 [8]. --M5 (talk) 13:14, 24 October 2018 (UTC)

Hi M5, corrected in develop branch. Thomas Linard (talk) 09:41, 1 March 2019 (UTC)

Page a bit big?

This massive page locked up my browser for ages, and I guess there are worse computers/phones out there. Perhaps it could be split into subpages or something? --ghouston (talk) 09:23, 16 January 2019 (UTC)

Yes, this really needs to be split up because there is just no sense in a table with 2.7k+ entries. Commons is not a directory. There is also a subpage Emoji/Table which seems to be way bigger even than the main gallery, so something went terribly wrong here. The minimum action should be moving both pages to names with a disclaimer like "Emoji (very large page)". De728631 (talk) 17:29, 17 March 2019 (UTC)
This is a valid concern, I replaced the page which a much smaller selection of a few emojis and a link the main table for the adventurous visitors. There is probably a better way to do it and present it than a table like this, but it's a quick fix. What do you think? ~ nicolas (talk) 21:00, 17 March 2019 (UTC)
If we can add {{:Emoji/Table/Intro}} at the top of Emoji/Table it would be perfect. I updated Talk:Emoji/code for it. ~ nicolas (talk) 21:18, 17 March 2019 (UTC)
I'm thinking of adding a second little gallery to Emoji presenting "Notable sets hosted on Commons", each with like 3-4 emoji a little bigger to see the style. Will do that soon. ~ nicolas (talk) 21:25, 17 March 2019 (UTC)
Just added that ~ nicolas (talk) 21:59, 17 March 2019 (UTC)
Thank you. This is definitely an improvement. De728631 (talk) 20:56, 21 March 2019 (UTC)

Unicode 11 (Noto Emoji Pie, Twemoji 11)

Hi,

Does someone intend to upload any Unicode 11 Emoji set, like Noto Emoji Pie (or, more exactly, the 2018-08-10-unicode11 version)? And Twemoji 11.2? Thomas Linard (talk) 15:21, 20 January 2019 (UTC)

And soon Twemoji 11.3. Thomas Linard (talk) 10:29, 24 January 2019 (UTC)
User:Thomas Linard, User:Nclm. That someone is usually me :) So are the mentioned sets should update/replace another collections or are new one? Thanks! −ebrahimtalk 08:58, 9 February 2019 (UTC)
Hi Ebrahim,
Great! I still don't figured the procedure. 😀 I don't know if we have to create new collections: Twemoji has changed name (Twemoji 2 to Twemoji 11, and soon Twemoji 12) to follow Unicode numbering, and the new Noto is an incremental update, but we're risking to have too many columns on this already very big table, no? Thomas Linard (talk) 10:20, 9 February 2019 (UTC)
Hi Ebrahim,
What can I do to advance the subject? After thinking, my opinion on the problem you've posed: we've to create two new categories (Noto Emoji v2018, Twemoji v11) and lighten the table by removing older versions. What do you think? Thomas Linard (talk) 16:30, 28 February 2019 (UTC)
Great that we now have them uploaded but to be honest I don't know! :) Here is the table updater code, feel free to use it for what you see best! −ebrahimtalk 21:29, 28 February 2019 (UTC)
Hi Ebrahim, I changed the code and simply added Noto Color Emoji Pie (Twemoji will stay in "version 2"). I've no confidence in my understanding of Python code, I hope I haven't broken everything! My proposition to keep the table in reasonable proportions: remove Noto Kitkat, Android, EmojiOne v1, Phantom Open Emoji (abandoned project). Do you agree? Thomas Linard (talk) 08:10, 1 March 2019 (UTC)
Hey there. The idea was to have most of them for comparison reasons. I would say remove the similar ones, if any, and/or/may replace Oreo or the uploaded Pie as they are apparently similar, or maybe not. −ebrahimtalk 23:39, 1 March 2019 (UTC)
Hi Ebrahim, if we want them for comparison reasons, we could as well keep them all (even between Noto Kitkat and Lollipop, there are differences). So, forget about it. Could you check the code to see if I've made any mistakes? Thanks! Thomas Linard (talk) 13:18, 2 March 2019 (UTC)
Yes, I am also not confident here... the changes look good! Except don't use that template, it will make issue for rendering of the page. Run the code to see what happens :P Thanks −ebrahimtalk 15:37, 2 March 2019 (UTC)
Well, lot of warnings and exceptions, but it worked. Thank you! Thomas Linard (talk) 21:45, 2 March 2019 (UTC)

Emoji/Table

Emoji/Table is 18.6 Mb (!) with 1,437,488 bytes of Wiki-code. If I can get it to open, I plan to split it into several parts, in a few days. Does anyone have any preference as to how it is split? Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 19:46, 30 March 2019 (UTC)

Hi, for information, the code is generated using update.py from Talk:Emoji/code, and Data:Emoji/List.tab as source. Thomas Linard (talk) 22:15, 30 March 2019 (UTC)

Categorisation

I was looking at Category:Emoji by theme and it is a bit of a mess, especially now that it is linked directly from the page Emoji as a way to browse the sets. Here is the current categorisation (minus some maintenance categories like Category:SVG images with embedded raster graphics: POE‎ or Category:Valid SVG created with Text Editor: Emoji 1bw‎ that maybe should be deleted at one point):

  • Emoji by theme
    • Android Emoji‎ (theme)
      • Android Emoji smilies‎ (subject)
    • Blob emoji‎ (subject in several themes)
    • Emoji One‎ (theme)
      • Emoji One - Derivations‎ (derivations)
      • Emoji One BW‎ (theme)
      • Emoji One v1‎ (theme)
      • Emoji One flags‎ (subject)
      • Emoji One smilies‎ (subject)
    • Emoji One BW‎ (theme)
    • Firefox OS Emoji‎ (theme)
      • Firefox OS Emoji/people (subject)
        • Firefox OS Emoji/people/smilies‎ (subject)
    • Noto Color Emoji‎ (family)
      • Noto Color Emoji - Derivations‎ (derivations)
      • Noto Color Emoji KitKat (theme)
      • Noto Color Emoji Lollipop‎ (theme)
      • Noto Color Emoji Nougat‎ (theme)
      • Noto Color Emoji Oreo‎ (theme)
      • Noto Color Emoji Pie (theme)
      • Noto Color Emoji smilies (subject)
    • OpenMoji‎ (family)
      • OpenMoji Black‎ (theme)
      • OpenMoji Color‎ (theme)
    • OpenMoji Black‎ (theme)
    • Phantom Open Emoji‎ (theme)
      • Phantom Open Emoji smilies (subject)
    • Streamline Emoji (theme)
    • Twemoji v2‎ (theme)
    • Twitter Emoji‎ (theme)
      • Twemoji clocks‎ (subject)
      • Twemoji smilies‎ (subject)
      • Twemoji v2 (theme)

As you can see, some categories for specific versions of a theme are both in the root category and in the category for their family (for instance “Twemoji v2” or “OpenMoji Black‎”), while some are not. At the same time, some versions don’t have their own category and are just in the family category (for instance the non-existing “Twemoji v1” or “Emoji One v2”), while other versions have a subcategory.

Some subcategories are cross sections between subjects and themes (for instance, “Emoji One flags‎”, “Noto Color Emoji smilies”, or “Firefox OS Emoji/people/smilies‎”). They can of get in the way but I understand their existence. There are also categories for derivations, which make sense. An outlier is “Blob emoji” that is a feature of both “Android Emoji‎” and certain version of “Noto Color Emoji”. I suggest removing in from “Emoji by theme” since it is not a theme in itself, and turning it into a parent category for “Android Emoji smilies‎” and future categories “Noto Color Emoji KitKat smilies”/“Noto Color Emoji Lollipop smilies”/etc (if that include every blob effectively).

Additionally, the name “theme” is confusing since we have Category:Emoji by subject as well, that could almost be a synonym depending on the meaning you give to “theme”. I suggest “set”, “font”, “design”, or “vendor”.

Here is an example of improved categorisation (here simplified without the subjects and derivations subcategories):

  • Emoji by theme/set/font/design/vendor
    • Android Emoji‎ (theme/family)
    • Emoji One‎ (family)
      • Emoji One - Version 1 (theme)
      • Emoji One - Version 2 (theme)
      • Emoji One - Version 2 BW (theme)
    • Firefox OS Emoji‎ (theme/family)
    • Noto Color Emoji‎ (family)
      • Noto Color Emoji - Version KitKat (theme)
      • Noto Color Emoji - Version Lollipop‎ (theme)
      • Noto Color Emoji - Version Nougat‎ (theme)
      • Noto Color Emoji - Version Oreo‎ (theme)
      • Noto Color Emoji - Version Pie (theme)
    • OpenMoji‎ (family)
      • OpenMoji Black‎ (theme)
      • OpenMoji Color‎ (theme)
    • Phantom Open Emoji‎ (theme/family)
    • Streamline Emoji (theme/family)
    • Twitter Emoji‎ (family)
      • Twitter Emoji‎ - Version 1 (theme)
      • Twitter Emoji - Version 2 (theme)

Each set as one parent category, and in the case of several versions, one subcategory for each version (that is clearly labelled as a version). No categories both have files and subcategories.

If ever for instance, say, Streamline Emoji gets a version 2, we will recategorise that part into:

    • Streamline Emoji (family)
      • Streamline Emoji‎ - Version 1 (theme)
      • Streamline Emoji - Version 2 (theme)

When adding subjects and derivations subcategories, it becomes something like that:

  • Emoji by theme/set/font/design/vendor
    • Android Emoji‎ (theme/family)
      • Android Emoji - Derivations (derivations)
      • Android Emoji - Smileys/Flags/People, etc. (subjects)
    • Emoji One‎ (family)
      • Emoji One - Version 1 (theme)
        • Emoji One - Version 1 - Smileys/Flags/People, etc. (subjects)
      • Emoji One - Version 2 (theme)
        • Emoji One - Version 2 - Smileys/Flags/People, etc. (subjects)
      • Emoji One - Version 2 BW (theme)
        • Emoji One - Version 3 BW - Smileys/Flags/People, etc. (subjects)
      • Emoji One - Derivations (derivations)
    • Firefox OS Emoji‎ (theme/family)
      • Firefox OS Emoji‎ - Derivations (derivations)
      • Firefox OS Emoji‎ - Smileys/Flags/People, etc. (subjects)
    • Noto Color Emoji‎ (family)
      • Noto Color Emoji - Version KitKat (theme)
        • Noto Color Emoji - Version KitKat - Smileys/Flags/People, etc. (subjects)
      • Noto Color Emoji - Version Lollipop‎ (theme)
        • Noto Color Emoji - Version Lollipop‎ - Smileys/Flags/People, etc. (subjects)
      • Noto Color Emoji - Version Nougat‎ (theme)
        • Noto Color Emoji - Version Nougat‎ - Smileys/Flags/People, etc. (subjects)
      • Noto Color Emoji - Version Oreo‎ (theme)
        • Noto Color Emoji - Version Oreo‎ - Smileys/Flags/People, etc. (subjects)
      • Noto Color Emoji - Version Pie (theme)
        • Noto Color Emoji - Version Pie - Smileys/Flags/People, etc. (subjects)
      • Noto Color Emoji‎ - Derivations (derivations)
    • OpenMoji‎ (family)
      • OpenMoji - Version Black‎ (theme)
        • OpenMoji - Version Black - Smileys/Flags/People, etc. (subjects)
      • OpenMoji - Version Color‎ (theme)
        • OpenMoji - Version Color - Smileys/Flags/People, etc. (subjects)
      • OpenMoji - Derivations (derivations)
    • Phantom Open Emoji‎ (theme/family)
      • Phantom Open Emoji‎ - Derivations (derivations)
      • Phantom Open Emoji‎‎ - Smileys/Flags/People, etc. (subjects)
    • Streamline Emoji (theme/family)
      • Streamline Emoji‎ - Derivations (derivations)
      • Streamline Emoji - Smileys/Flags/People, etc. (subjects)
    • Twitter Emoji‎ (family)
      • Twitter Emoji‎ - Version 1 (theme)
        • Twitter Emoji‎ - Version 1- Smileys/Flags/People, etc. (subjects)
      • Twitter Emoji - Version 2 (theme)
        • Twitter Emoji‎ - Version 2 - Smileys/Flags/People, etc. (subjects)
      • Twitter Emoji - Derivations (derivations)

“Smileys/Flags/People, etc.” represents multiple categories for each subject. These subcategories should also be categories of the subjects in Category:Emoji by subject.

I’m not sure how to perform changes like that since Cat-a-lot seems mostly about moving files rather than categories themselves.

What do you think?

~ nicolas (talk) 11:59, 16 June 2019 (UTC)

Hi @Nclm: I've done some changes, it's already less of a mess. You can do more if you want. Thomas Linard (talk) 09:56, 15 August 2019 (UTC)

Twemoji 12

We should also add the latest version of Twemoji, Twemoji 12, in its own category (not replacing v2). ~ nicolas (talk) 13:12, 16 June 2019 (UTC)

Agreed. Done. Thomas Linard (talk) 23:21, 1 August 2019 (UTC)

Emoji 13

Hi,

The complete table was getting too big and crashed frequently. For Unicode 13 (Emoji 13), I had to make drastic simplifications and I updated Talk:Emoji/code and Data:Emoji/List.tab. The table is now up to date. Thomas Linard (talk) 15:52, 2 April 2020 (UTC)

browsing

Commons and this collection is very useful, but how can you browse it sorted by something like {{NUMBEROFVIEWS}} (https://www.mediawiki.org/wiki/Help:Magic_words#Statistics) or "Page views in the past 30 days" (https://commons.wikimedia.org/w/index.php?title=File:Twemoji12_1f4a9.svg&action=info#mw-pvi-month-count) or the count from "What links here" e. g. Special:WhatLinksHere/File:Twemoji12_1f4a9.svg, or external usage statistics per Unicode codes.

Any additional ideas for cross-set charts like on Wikipedia Unicode pages would be appreciated. — Preceding unsigned comment was added by 83.31.136.27 (talk) 18:51, 15 June 2020 (UTC)

Retrieved from "https://commons.wikimedia.org/w/index.php?title=Talk:Emoji/Archive_1&oldid=707325507"