python - NLTK perplexity error -

-

i got error message

traceback (most recent call last):       file "c:/users/shengrong/desktop/bigram", line 55, in <module>         bg = bigram(file)       file "c:/users/shengrong/desktop/bigram", line 43, in bigram         return tt1.perplexity(my_bigrams)       file "c:\python27\lib\site-packages\nltk\model\ngram.py", line 217, in perplexity         return pow(2.0, self.entropy(text))       file "c:\python27\lib\site-packages\nltk\model\ngram.py", line 205, in entropy         e += self.logprob(token, context)       file "c:\python27\lib\site-packages\nltk\model\ngram.py", line 151, in logprob         return -log(self.prob(word, context), 2)     valueerror: math domain error     import os,csv,nltk nltk.model.ngram import ngrammodel nltk.probability import lidstoneprobdist  fout = open("/users/shengrong/documents/personal/wn1.data.csv", "w")  outfilehandle = csv.writer(fout,                            delimiter=",",                            quotechar='"',                            quoting=csv.quote_nonnumeric)     localrow = [] localrow.append("file name") localrow.append("perplexity unigram") localrow.append("perplexity bigram") localrow.append("perplexity trigram") outfilehandle.writerow(localrow)  def bigram(file):    file_object = open(file)    ln=file_object.read()     words = nltk.word_tokenize(ln)    my_bigrams = nltk.bigrams(words)    my_trigrams = nltk.trigrams(words)       tt1=ngrammodel(2, my_bigrams, estimator = none)      return tt1.perplexity(my_bigrams)         #set path of folder  os.chdir("/users/shengrong/documents/a")  s = os.getcwd()  #search files in folder  files = os.listdir(s)   file in files:     bg = bigram(file)     localrow= []     localrow.append(file)     localrow.append(bg)      outfilehandle.writerow(localrow)  fout.close()

how fix problem? without using loop read folder, code working well.

thank guys.

the error getting math domain error. since works without loop, may 1 or more of files contains data cannot processed math package.

please confirm files in folder contains data in correct format , expected values.


Comments

Post a Comment

Popular posts from this blog

javascript - DIV "hiding" when changing dropdown value -

-
this related previous question asked: hide / show multiple divs i have code in place previous question , seems work ok apart when change value in dropdown "after" ticket selection made. i have number of javascrpts in place wondering if there clash somewhere? first bit of code in head of document. <head> <script type="text/javascript"> $(function() { $('.cat_dropdown').change(function() { $('#paymethod').toggle($(this).val() >= 2); }); }); </script> <script type="text/javascript"> $(document).ready(function () { $(".paymentmethod").click(function () { $(".paymentinfo").hide(); switch ($(this).val()) { case "credit card authorisation": $("#pay0").show("slow"); break; ...
Read more

Does Firefox offer AppleScript support to get URL of windows? -

-
i trying write applescript that, among other things, gets url of every open webpage in firefox. in safari (and chrome), done simply: tell application "safari" return url of every tab in every window however, seems me firefox offers no real applescript support, such getting url of tab or window. when google terms "firefox" , "applescript" together, firefox bug requests asking applescript support restored, last updated in 2010 or 2011 (like this , this ). am right in thinking, then, firefox no longer offers proper applescript support? realize there semi-workarounds, such simulating key-commands in applescript, aren't practical purposes. to see of applescript commands firefox responds to, launch applescript editor, select menu file > open dictionary... , , choose firefox application. you'll find you're expecting: firefox doesn't offer useful applescript commands.
Read more

android - How to install packaged app on Firefox for mobile? -

-
how test-install packaged (zip) app on fennec? device: physical android phone or android emulator, don't care. install mozilla-apk-cli using npm: npm install -g mozilla-apk-cli use generate "debuggable" apk app either source directory or url mini-manifest: mozilla-apk-cli /path/to/source/dir/ arbitrary-name.apk mozilla-apk-cli http://example.com/path/to/mini/manifest.webapp arbitrary-name.apk (context-click > inspect element on "free" button in marketplace discover mini-manifest url app in marketplace.) install apk on android device: adb install -r arbitrary-name.apk launch app on device. notification area notification port remote debugger server listening on. forward port on desktop, f.e. if port 12345: adb forward tcp:12345 tcp:12345 go web developer > connect… in firefox on desktop , connect localhost @ forwarded port. commence debugging! notes: use nightly builds of fennec best experience. bug 929382 tracks ...
Read more