python 3.x - Find probability of a string in multiple text files -


i have 2 text files on 500 words each , have string say, x = 'this sample test'
need find probability of each word of string in both files , compare them each other find file has maximum probability contain string

`import nltk import random import math import numpy np nltk.tokenize import word_tokenize tokenize nltk.tokenize import sent_tokenize sentize nltk.corpus import state_union collections import counter collections import defaultdict   #open files bonjovi_text = open('bonjovi.txt').read() edward_text = open('edward.txt').read()  #tokenize files word_tokenizer_bonjovi = tokenize(bonjovi_text.lower()) word_tokenizer_edward = tokenize(edward_text.lower())  #define counter , dictionary priors = counter() classifier = defaultdict(counter)  #call dictionary classifier['bonjovi'] =(counter(word_tokenizer_bonjovi)) classifier['edward'] =(counter(word_tokenizer_edward))   enter = input('enter query:') enter = enter.lower() rlist = enter.split() finallist = np.zeros(2) print (rlist)  #search file 1 word in rlist:      filter_query = (classifier['bonjovi'][(word)])     wordprob_bonjovi = (1+filter_query)/((sum(classifier['bonjovi'].values()))+len(classifier['bonjovi']))     classprob = 1/(len(classifier.keys()))     bon_probabilit = math.log(classprob*wordprob_bonjovi)     previous = finallist[0]     finallist[0] = previous + bon_probabilit   print(np.argmax(finallist))  #search file 2   word in rlist:      search_query = (classifier['edward'][(word)])     wordprob_edward = (1+search_query)/(sum(classifier['edward'].values())+len(classifier['edward']))  #probability of each word in list     classprob2 = 1/(len(classifier.keys()))     edward_probability = math.log(classprob2*wordprob_edward)  #probability of word multiplied class probability     previous = finallist[1]     finallist[1] = previous + edward_probability              print(finallist)  print(np.argmax(finallist))`

the text 2 files below:

bonjovi: ain't song broken-hearted no silent prayer faith-departed ain't gonna face in crowd you're gonna hear voice when shout out loud

it's life it's or never ain't gonna live forever want live while i'm alive (it's life) heart open highway frankie said did way want live while i'm alive it's life

this ones stood ground it's tommy , gina never backed down tomorrow's getting harder, make no mistake luck ain't enough you've got make own breaks

it's life , it's or never ain't gonna live forever want live while i'm alive (it's life) heart open highway frankie said did way want live while i'm alive it's life

you better stand tall when they're calling out don't bend, don't break, baby, don't down

it's life , it's or never ain't gonna live forever want live while i'm alive (it's life) heart open highway frankie said did way want live while i'm alive (it's life)

edward: i'm dreaming, i'm dreaming out loud i'm searching missing part of heart uuuuu uuuu uuuu, catch me every time fall when eyes know tell me lies

this, life i'm looking searching love in eyes this, life i'm chasing dream fade away in night

can soul, i'll make lose control, i'll sun in night

just come here inside i'm playing i'm falling when eyes know tell me lies

ref: this, life i'm looking searching love in eyes this, life i'm chasing dream fade away in night

i can't follow dreams forever see them fall apart can change world if 'cause know won't let go when eyes know tell me lies

this, life i'm looking searching love in eyes this, life i'm chasing dream fade away in night start miss smile, voice hear i'm chasing hollow eyes, show me i'm wrong tonight this, life i'm looking searching love in eyes this, life i'm chasing dream fade away in night


Comments

Post a Comment

Popular posts from this blog

resizing Telegram inline keyboard -

telegram's inline keyboard great feature lots of different use cases. inline buttons added list of items this: inline_keyboard = [[inlinekeyboardbutton(text="button", callback_data="button"), inlinekeyboardbutton(text="reset",callback_data="reset")]] inline_keyboard_markup = inlinekeyboardmarkup(inline_keyboard) update.message.reply_text("hi", reply_markup=inline_keyboard_markup) the above code adds 2 buttons each half width of chat screen. i know the normal keyboard button there resize_keyboard parameter somehow can used. my question is there way resize inline buttons ? example make full width or quarter width. unfortunately, can't now. :( you can suggest @botsupport , might add feature next version.
Read more

command line - How can a Python program background itself? -

consider following python command-line program. doesn't work because incomplete, think illustrates problem: #!/usr/bin/python3 import multiprocessing pool = multiprocessing.pool() task in expensive_iterator_with_user_interaction(): pool.call_async(expensive_computation, (task,)) pool.close() print("dear user, may press ctrl-z , bg script.") pool.join() thus, problem scripts needs user input while it's launching expensive parallel processes. there moment when user interaction not needed anymore. then, ask user background process shell actions. however, can achieved program itself? (side note: core of problem entanglement of user input firing “expensive computations”. therefore, cannot separate both in 2 scripts, , letting 1 spawning other daemon.) the command screen may you. use screen -l create new session , run application. after inputting data, can press " ctrl-a " , press " d " on keyboard detach session. now...
Read more

php - "cURL error 28: Resolving timed out" on Wordpress on Azure App Service on Linux -

Image
my wordpress installation on azure app service on linux using custom docker container has slow response times. pages take around 20-40 seconds load. i have troubleshooting plugin installed indicates problem "curl error 28: resolving timed out after n milliseconds" when making requests following urls https://api.wordpress.org/core/version-check/1.7/ http://api.wordpress.org/core/version-check/1.7/ https://api.wordpress.org/plugins/update-check/1.1/ http://api.wordpress.org/plugins/update-check/1.1/ https://api.wordpress.org/themes/update-check/1.1/ http://api.wordpress.org/themes/update-check/1.1/ curl works fine on scm-site command line. example works ok. curl -x post http://api.wordpress.org/core/version-check/1.7/ edit if ssh container , run php code, works fine. <?php $url = 'http://api.wordpress.org/core/version-check/1.7/'; $fields = array( 'version' => urlencode('4.8.1'), 'php' => urlencode(...
Read more