Differences

This shows you the differences between two versions of the page.

--- annotating_sub-word_morphemes [2015/09/09 07:18] – ctschroeder
+++ annotating_sub-word_morphemes [2015/10/14 12:11] (current) – admin
@@ Line 1: / Line 1: @@
 === Create a morph layer ===
+There are multiple ways of creating a morph layer.
+== Follow these steps if you have no morph layer at all ==
+Duplicate the norm layer. Name the new layer "ignore:morph".
+Manually or [[google_refine|using Google Refine]] identify the normalized words that need to be annotated on the morph level.  (See the [[http://copticscriptorium.org/download/tools/SCRIPTORIUMDiplTranscriptionGuidelines.pdf|Transcription Guidelines]] for more information about normalized words vs morphs.)
+Split the words you have identified into the requisite number of tokens.
+  * Be sure to break up the words in the **tok** and the **ignore:morph** layers.  (Therefore, you may need to add rows to your spreadsheet.)
+  * Ensure the norm, orig, norm_group, orig_group, pos, lemma, hi@rend, and other annotation layers stay aligned with the correct tokens.
+  * Do not break up the words in the norm or orig layers; only the tok and ignore:morph layers
+Consider using [[google_refine|Google Refine]] to check your work (see if compound words or words containing mnt-, at-, ref-, etc., are still in the ignore:morph layer).
+Complete the steps in the next section to create the morph layer.
+== Follow these steps if/when your file has an ignore:morph layer ==
 Many of these steps are demonstrated in this [[https://www.youtube.com/watch?v=ptexY-zaNcI|video]].
-You need to create a clean morph layer that has only unique data in it; 80-90% of the data is identical to the data in norm, making it difficult for a human to see when you’ve got compound words or morphs.  It’s cluttered.  So the morph layer in our published annotated corpora only contains unique data that differs from the word-level layers.  (Word-level layers in Coptic SCRIPTORIUM are usually named "orig" and "norm.")
+You need to create a clean morph layer that has only unique data in it; 80-90% of the data in ignore:morph is identical to the data in norm, making it difficult for a human to see when you’ve got compound words or morphs.  It’s cluttered.  So the morph layer in our published annotated corpora only contains unique data that differs from the word-level layers.  (Word-level layers in Coptic SCRIPTORIUM are usually named "orig" and "norm.")
 . Insert a new column for the morph layer but it should be empty (as in the video)
@@ Line 12: / Line 31: @@
 . Select the cell with your formula in it and select the rest of the column down to the end of the layer data. Use the “Edit>Fill>Down” menu item to fill in that column with the formula.  You should now have a clean morph layer that contains only the relevant morphs when they appear.