********************* $ bash "$d_bin"'blog/blog analysis.sh' +-----+ basics- keyWrdA_setup, pTxt_to_pWrdL : keyWrdA_setup() - create an array of keywords from catenation of several keyword files pTxt_to_pWrdL() - extract all words in pTxt (mv this to fileops.sh later) pWrdL_rmStdDictionary_pNovel() - rm words from pWrdL that are in the Linux dictionary 14Oct2024 mv this to fileops.sh later +-----+ transcription processing [manual, auto] stages : pCmtBig_process() - save comments longer than pMinSize to pCmtBig pCmtKey_process() - augment pCmtBig with keyword scores pCmtScr_process() - filter pCmtKey by keyword score manually mark ALL pCmtScr comments with [#+, #-] to [select, ignore] (huge work) pInnOut_process() - filter pInnOut by OR("^#+' = Inn), depending on manually mark a copy of ALL pCmtInn with [#> , #>>] lists of fNams (huge work) the fNams apply of [all, part] of comment +-----+ themes processing : getRestOfCmtL() - adds '#> ' marked fNamThemes to array restOfCmtL restOfCmtL applies to the rest of a comment getParagraphL() - adds '#>> ' marked fNamThemes to array paragraphL paragraphL applies only to a "paragraph", can be line sequence without whiteLines pCmtTmp_typ_save_pThemeAry() - appends [author, line of a comment] to applicable theme files pCmtThm_process() - processes a single comment, allocating parts to [pCmtRest, pCmtParg]s +-----+ Blog comment processing, common approach : pBlog_get_pCmt() - gets lines of a single comment pBlog_process() - process a blog txt file +-----+ tests, except themes tests handled separately : test_keyWrdA_setup() - pCmtKey_process_test() - pCmtBig -> add [scoreTotal, keyWrdL] -> pCmtKey test_pCmtKey_process() - 14Oct2024 this is messed up! +-----+ blog: summary of classification after manual annotations pCmtScr_getIOCount_pLog() - InnOut counts in pCmtScr, saved to pLog pCmtScr_get_pIOMisL() - get list of scores that don't have annotation eg '#] 2 0 0 0 0 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0'