python - Output SQL as string from pandas.DataFrame.to_sql -


is there way of making pandas (or sqlalchemy) output sql executed call to_sql() instead of executing it? handy in many cases need update multiple databases same data python , pandas exists in 1 of machines.

this more process question programming one. first, use of multiple databases. relational databases management systems (rdmbs) designed multiple-user systems many simultaneous users/apps/clients/machines. designed run 1 system, database serves central repository related applications. argue databases should agnostic apps , data-centric (postgre folks) , others believe databases should app-centric (mysql folks). overall, understand more involved flatfile spreadsheet or data frame.

usually, rdms's come in 2 structural types:

  1. file level systems sqlite , ms access (where databases reside in file saved cpu directory); these systems though still powerful , multi-user serve smaller business applications relatively handful of users or team sizes
  2. server-level systems sql server, mysql, postgresql, db2, oracle (where databases run on network without localized file); these systems serve enterprise level systems run full-scale business operations run on lan intranets or web networks.

meanwhile, pandas not database data analysis toolkit (much ms excel) though can import/export queried resultsets rdms's. therefore, maintains no native sql dialect ddl/dml procedures. moreover, pandas runs in memory on os calling python script , cannot shared other clients/machines. pandas not track changes intend in order know different states of data frame during runtime of script unless design way before , after , identify column/row changes.

with mouthful said, why not use 1 database , have python script serve of many clients connect database import/export data data frame. hence, after every data frame change run to_sql(). recall pandas' to_sql uses if_exists argument:

# drops table, recreates it, , updates df.to_sql(name='tablename', con=conn, if_exists='replace')  # appends df data existing table df.to_sql(name='tablename', con=conn, if_exists='append')

in turn, every app/machine connects centralized database need refresh instance , current data available in real-time end use needs. though of course, table-locking states can issue in multi-user environments if user had table record in edit mode while script tried updating it. transactions here may help.


Comments

Post a Comment

Popular posts from this blog

resizing Telegram inline keyboard -

telegram's inline keyboard great feature lots of different use cases. inline buttons added list of items this: inline_keyboard = [[inlinekeyboardbutton(text="button", callback_data="button"), inlinekeyboardbutton(text="reset",callback_data="reset")]] inline_keyboard_markup = inlinekeyboardmarkup(inline_keyboard) update.message.reply_text("hi", reply_markup=inline_keyboard_markup) the above code adds 2 buttons each half width of chat screen. i know the normal keyboard button there resize_keyboard parameter somehow can used. my question is there way resize inline buttons ? example make full width or quarter width. unfortunately, can't now. :( you can suggest @botsupport , might add feature next version.
Read more

command line - How can a Python program background itself? -

consider following python command-line program. doesn't work because incomplete, think illustrates problem: #!/usr/bin/python3 import multiprocessing pool = multiprocessing.pool() task in expensive_iterator_with_user_interaction(): pool.call_async(expensive_computation, (task,)) pool.close() print("dear user, may press ctrl-z , bg script.") pool.join() thus, problem scripts needs user input while it's launching expensive parallel processes. there moment when user interaction not needed anymore. then, ask user background process shell actions. however, can achieved program itself? (side note: core of problem entanglement of user input firing “expensive computations”. therefore, cannot separate both in 2 scripts, , letting 1 spawning other daemon.) the command screen may you. use screen -l create new session , run application. after inputting data, can press " ctrl-a " , press " d " on keyboard detach session. now...
Read more

php - "cURL error 28: Resolving timed out" on Wordpress on Azure App Service on Linux -

Image
my wordpress installation on azure app service on linux using custom docker container has slow response times. pages take around 20-40 seconds load. i have troubleshooting plugin installed indicates problem "curl error 28: resolving timed out after n milliseconds" when making requests following urls https://api.wordpress.org/core/version-check/1.7/ http://api.wordpress.org/core/version-check/1.7/ https://api.wordpress.org/plugins/update-check/1.1/ http://api.wordpress.org/plugins/update-check/1.1/ https://api.wordpress.org/themes/update-check/1.1/ http://api.wordpress.org/themes/update-check/1.1/ curl works fine on scm-site command line. example works ok. curl -x post http://api.wordpress.org/core/version-check/1.7/ edit if ssh container , run php code, works fine. <?php $url = 'http://api.wordpress.org/core/version-check/1.7/'; $fields = array( 'version' => urlencode('4.8.1'), 'php' => urlencode(...
Read more