csv - mysql load data local infile syntax issues with set fields -


i'm trying use mysql's load data local infile syntax load .csv file existing table. here 1 record .csv file (with headers):

 prod,       plant,pord,  revn,a_cpn,     a_crev,brdi,       dte,     ltme  100100128144,12t1,2070000,04,3db18194acaa,05_01,ala13320004,20130807,171442

the issue want 3 things done during import:

  1. a recordid int not null auto_integer primary_key field should incremented each row gets inserted (this table column , structure exists within mysql table)

  2. dte , ltme should concatenated , converted mysql datetime format , inserted existing mysql column named trans_ocr

  3. a created timestamp field should set current unix timestamp on row insertion (this table column , structure exists within mysql table)

i'm trying import data mysql table following command:

 load data local infile 'myfile.csv' table seriallog  fields terminated ',' optionally enclosed '\"'  lines terminated '\n'  ignore 1 lines  (flex_pn, flex_plant, flex_ordid, flex_rev, cust_pn, cust_rev, serialid)  set created = current_timestamp;

i think have created column set others causing mysql warning issued:

warning: out of range value column 'flex_pn' @ row 1 warning: row 1 truncated; contained more data there input columns

can me syntax, load data local infile module confusing me...

figured out proper syntax make work:

sql = """load data local infile %s table seriallog_dev           fields terminated ',' optionally enclosed '\"'           lines terminated '\\n'           ignore 1 lines           (flex_pn, flex_plant, flex_ordid, flex_rev, cust_pn, cust_rev, serialid, @dte, @ltme)           set recordid = null,               trans_ocr = str_to_date(concat(@dte,'',@ltme), "%%y%%m%%d%%h%%i%%s"),               created = current_timestamp;"""  params = (file,) self.db.query( sql, params )

mind you--this done python's mysqldb module.

caveat

the issue solution reason bulk insert inserts first 217 rows of data file. total file size 19kb can't imagine large mysql buffers... gives?

more info

also, tried syntax directly within msyql-server cli , works 255 records. so, problem python, python mysqldb module, or mysql connection mysqldb module makes...

done

i figured out problem, had nothing load data local infile command rather method using convert original .dbf file .csv before attempting import .csv. reason mysql import method running on .csv before .dbf .csv conversion method finished -- resulting in partial data set being found in .csv file , imported... sorry waste everyone's time!


Comments

Post a Comment

Popular posts from this blog

How to remove text and logo OR add Overflow on Android ActionBar using AppCompat on API 8? -

have researched death , cannot find answer. i have actionbar using appcompat. supporting api v7 (api v8 do). actionbar works api v11. api < v11 has problem of removing icon (and feature) actionbar without supplying overflow. big picture have app logo, app title, , 3 icons squidging same actionbar on low end phone. trying make room! i happy 1 of 2 solutions. either: a method of getting overflow functionality can retrieved pull down. (preferred) method of removing icon , text actionbar below current xml api 11+: <resources> <!-- base application theme api 11+. theme replaces appbasetheme res/values/styles.xml on api 11+ devices. --> <style name="appbasetheme" parent="theme.appcompat.light.darkactionbar"> <item name="android:actionbarstyle">@style/liteactionbarstyle</item> <item name="actionbarstyle">@style/liteactionbarstyle</item> </st...
Read more

html - How to style widget with post count different than without post count -

i have border below li elements in wordpress widget types appropriate. element inside set block gives them nice easy click full width. the problem, when choose option "show post count" when adding widget such categories or archives displays post count plain text after tag , because tag block pushes post number text line below. whether choose show post count or not show post count still gives exact same element identifyer example "widget_categories". how style post count not on next line still keep links non post count list items full width? here's example on sidebar www.bbmthemes.com/themes/modular/blog-standard/ in order solve problem need remove display:block; for ul.widgets ul a , add in it's place line-height: 33px; what going achieve have same visual effect. what going lose doing links going work on text , not on "box". the other way out of find post count coming , make changes this. example change text count i...
Read more

url rewriting - How to redirect a http POST with urlrewritefilter -

i have question urlrewritefilter , until not find in net. i want redirect http post in tomcat7. here example... the call http post ulr http://localhost:8080/oldapplication/example?a=123&b=2 this call contains content either xml or json. filter configured works , urlrewrite.xml contains: <?xml version="1.0" encoding="utf-8"?> <!doctype urlrewrite public "-//tuckey.org//dtd urlrewrite 4.0//en" "http://www.tuckey.org/res/dtds/urlrewrite4.0.dtd"> <urlrewrite use-query-string="true"> <rule> <condition type="method">post</condition> <from>^(.*)$</from> <to type="redirect">/newapplication$1</to> </rule> </urlrewrite> in access log can see call http://localhost:8080/oldapplication/example?a=123&b=2 gets redirected http://localhost:8080/newapplication/example?a=123&b=2 fine until now. pr...
Read more