python - Parsing uncommon symbol using BeautifulSoup -

-

i have link <a href=abc.asp?xyz=foobar&baz=lookatme´_beautiful.jpg> , there unusual symbol ´ , not present in standard english keyboard. mirror reflection of symbol ctrl+k produces in editor . after ran code found on stackoverflow:

soup = beautifulsoup.beautifulsoup("<a href=abc.asp?xyz=foobar&baz=lookatme´_beautiful.jpg>"); in soup.findall('a'):                                                                            print a['href']

the output abc.asp?xyz=foobar&baz=lookatme want have abc.asp?xyz=foobar&baz=lookatme´_beautiful.jpg . website i'm scraping in .br domain . of writings in portugese , though links in english , uncommon symbol may not valid english language symbol. thoughts or suggestions ?

edit: looked @ representation python string produced me , <a href=abc.asp?xyz=foobar&baz=lookatme\xb4_beautiful.jpg>

one way around produce custom regex , , snippet stackoverflow:

import re urls = re.findall(r'href=[\'"]?([^\'" >]+)', s)

if impossible modify beautifulsoup regex , how can modify above regex incorporate \xb4 symbol. ( s here string in question )

upgrade latest version of beautifulsoup , install html5lib, lenient parser:

import requests bs4 import beautifulsoup  html = requests.get('http://www.atlasdermatologico.com.br/listar.asp?acao=indice').text soup = beautifulsoup(html, 'html5lib')  in soup.find_all('a'):     href = a.get('href')      if '\\' in repr(href):         print(repr(href))

it correctly prints out links \xb4 in url.


Comments

Post a Comment

Popular posts from this blog

javascript - DIV "hiding" when changing dropdown value -

-
this related previous question asked: hide / show multiple divs i have code in place previous question , seems work ok apart when change value in dropdown "after" ticket selection made. i have number of javascrpts in place wondering if there clash somewhere? first bit of code in head of document. <head> <script type="text/javascript"> $(function() { $('.cat_dropdown').change(function() { $('#paymethod').toggle($(this).val() >= 2); }); }); </script> <script type="text/javascript"> $(document).ready(function () { $(".paymentmethod").click(function () { $(".paymentinfo").hide(); switch ($(this).val()) { case "credit card authorisation": $("#pay0").show("slow"); break; ...
Read more

html - Accumulated Depreciation of Assets on php -

-
i have problem table print out asset accumulated depreciation on php, stright line method. $query = mysqli_query($connect, "select current_value, salvage_value, useful_life, placed_service assets"); if(!$query){ echo 'could not run query b: ' . mysqli_error($connect); exit; } while($asset = mysqli_fetch_row($query)){ echo "assets :"; print_r($asset); $month = 12; $year = date('y',strtotime($asset[3])); $first_year = $month - ((int)date('m',strtotime($asset[3]))-1); $last_year = $month - $first_year; $first = round((($asset[0] - $asset[1])/$asset[2])*(($first_year)/12),0); $last = round((($asset[0] - $asset[1])/$asset[2])*(($last_year)/12),0); $others = ($asset[0] - $asset[1])/$asset[2]; echo "<table border=1>"; echo "<tr><th>year</th><th>book value year start</th><th>depreciation expense</th><th...
Read more

Update QSQLTableModel in QT C++ -

-
i created 1 dialog used bindvalues in sql database, , can save every new record sucessfully. problem i've got dialog qsqltablemodel shows information database. every time make new record must close program , run again see changes in showinformationdialog() . know way such don't need close program update information in showinformationdialog() ? you can use select() method of qsqltablemodel class repopulate model data database. bound views updated automatically. suggest connecting signal wherever update data in database (i.e. dialog updating sql database) custom slot in showinformationdialog() calls select() of qsqltablemodel object. assume have qmainwindow object parent of both dialogues best place establish connection. also since showinformationdialog() 's model used viewing data consider using qsqlquerymodel . if used setquery() method should used instead of select() otherwise (the connection of signal showinformationdialog() 's slot) same. ...
Read more