SQL Power Software Forum

Hi!

It seems Google Address Lookup may be broken

2010-01-07 17:09:40,946 DEBUG Order of processing: [a_buildings1_dub: opened=false committed=false rolledBack=true [Inputs:] [Outputs: <objectid: 13177> <bld_type: 6> <name_e: Courts> <source: Photogrammetry> <shape_leng: 546.42369764> <dgis_id: 12774> <x_coord: 330925.51424> <y_coord: 2793497.10666> <shape_length: 546.398691871296> <shape_area: 10886.6295979211> <name_looked_up: null> <lat: 0> <lng: 0>] [Parameters: <expanded:true> <y:73> <x:144>], Upper Case: opened=false committed=false rolledBack=true [Inputs: <name_e: Courts>] [Outputs: <upperCaseOutput: COURTS>] [Parameters: <y:272> <x:129>], Translate Words: opened=false committed=false rolledBack=true [Inputs: <upperCaseOutput: COURTS>] [Outputs: <translateWordOutput: COURTS>] [Parameters: <translateGroupOid:1> <caseSensitive:true> <useRegex:true> <expanded:true> <y:362> <x:66>], String constant: opened=false committed=false rolledBack=true [Inputs:] [Outputs: <Value: Dubai>] [Parameters: <return null:False> <value:Dubai> <expanded:true> <y:101> <x:555>], String constant: opened=false committed=false rolledBack=true [Inputs:] [Outputs: <Value: UAE>] [Parameters: <return null:False> <value:UAE> <expanded:true> <y:105> <x:768>], Concat: opened=false committed=false rolledBack=true [Inputs: <name_e: Courts> <Value: Dubai> <Value: UAE> null] [Outputs: <concatOutput: Courts, Dubai, UAE>] [Parameters: <delimiter:, > <expanded:true> <y:259> <x:623>], Google Maps Address Lookup: opened=false committed=false rolledBack=true [Inputs: <concatOutput: Courts, Dubai, UAE>] [Outputs: <Lookup Status: null> <Country Code: null> <Administrative Area: null> <Sub-Administrative Area: null> <Locality: null> <Street Address: null> <Postal Code: null> <Latitude: null> <Longitude: null> <Accuracy Code: null>] [Parameters: <GoogleGeocoderUrl:http://maps.google.com/maps/geo> <GoogleMapsApiKey:ABQIAAAAjuTfolYeTMQEEMnSt_GCLhRH5Ag-HcVl75qhJqki4fmF0NXdrRTt0p1WXlC5jaecjwR59nPnJR8qSA> <expanded:false> <LookupRateLimit:2.0> <y:392> <x:637>], a_buildings1_dub: opened=false committed=false rolledBack=true [Inputs: <objectid: 13177> <bld_type: 6> <name_e: Courts> <source: Photogrammetry> <shape_leng: 546.42369764> <dgis_id: 12774> <x_coord: 330925.51424> <y_coord: 2793497.10666> <shape_length: 546.398691871296> <shape_area: 10886.6295979211> <translateWordOutput: COURTS> <Latitude: null> <Longitude: null>] [Outputs:] [Parameters: <expanded:true> <y:528> <x:325>]]
2010-01-07 17:09:40,947 DEBUG Opening MungeStep a_buildings1_dub
2010-01-07 17:09:40,947 DEBUG Attempting to execute input query: SELECT
 objectid,
 bld_type,
 name_e,
 source,
 shape_leng,
 dgis_id,
 x_coord,
 y_coord,
 shape_length,
 shape_area,
 name_looked_up,
 lat,
 lng
FROM geostage.public.a_buildings1_dub
WHERE name_e is not null
2010-01-07 17:09:40,955 DEBUG ResultSet fetch size is: 100
2010-01-07 17:09:40,956 DEBUG Opening MungeStep Upper Case
2010-01-07 17:09:40,956 DEBUG Opening MungeStep Translate Words
2010-01-07 17:09:40,958 DEBUG Opening MungeStep String constant
2010-01-07 17:09:40,958 DEBUG Opening MungeStep String constant
2010-01-07 17:09:40,960 DEBUG Opening MungeStep Concat
2010-01-07 17:09:40,962 DEBUG Opening MungeStep Google Maps Address Lookup
2010-01-07 17:09:40,963 DEBUG Opening MungeStep a_buildings1_dub
2010-01-07 17:09:40,963 DEBUG a_buildings1_dub Inputs: 
2010-01-07 17:09:40,963 DEBUG a_buildings1_dub Outputs: [ objectid: 13177 ] [ bld_type: 6 ] [ name_e: Courts ] [ source: Photogrammetry ] [ shape_leng: 546.42369764 ] [ dgis_id: 12774 ] [ x_coord: 330925.51424 ] [ y_coord: 2793497.10666 ] [ shape_length: 546.398691871296 ] [ shape_area: 10886.6295979211 ] [ name_looked_up: null ] [ lat: null ] [ lng: null ] 
2010-01-07 17:09:40,963 DEBUG Upper Case Inputs: [ name_e: Courts ] 
2010-01-07 17:09:40,964 DEBUG Upper Case Outputs: [ upperCaseOutput: COURTS ] 
2010-01-07 17:09:40,964 DEBUG Translate Words Inputs: [ upperCaseOutput: COURTS ] 
2010-01-07 17:09:40,965 DEBUG Translate Words Outputs: [ translateWordOutput: COURTS ] 
2010-01-07 17:09:40,965 DEBUG String constant Inputs: 
2010-01-07 17:09:40,966 DEBUG String constant Outputs: [ Value: Dubai ] 
2010-01-07 17:09:40,967 DEBUG String constant Inputs: 
2010-01-07 17:09:40,967 DEBUG String constant Outputs: [ Value: UAE ] 
2010-01-07 17:09:40,967 DEBUG Concat Inputs: [ name_e: Courts ] [ Value: Dubai ] [ Value: UAE ] [ null ] 
2010-01-07 17:09:40,967 DEBUG Concat Outputs: [ concatOutput: Courts, Dubai, UAE ] 
2010-01-07 17:09:40,967 DEBUG Google Maps Address Lookup Inputs: [ concatOutput: Courts, Dubai, UAE ] 
2010-01-07 17:09:41,348 DEBUG Address Lookup Response for "Courts, Dubai, UAE": {
  "name": "Courts, Dubai, UAE",
  "Status": {
    "code": 200,
    "request": "geocode"
  },
  "Placemark": [ {
    "id": "p1",
    "address": "Dubai Courts 1 - Dubai - United Arab Emirates",
    "AddressDetails": {
   "Accuracy" : 9,
   "AddressLine" : [ "Dubai Courts 1" ]
},
    "ExtendedData": {
      "LatLonBox": {
        "north": 25.2501966,
        "south": 25.2439014,
        "east": 55.3237266,
        "west": 55.3174314
      }
    },
    "Point": {
      "coordinates": [ 55.3205790, 25.2470490, 0 ]
    }
  }, {
    "id": "p2",
    "address": "Dubai Courts 2 - Dubai - United Arab Emirates",
    "AddressDetails": {
   "Accuracy" : 9,
   "AddressLine" : [ "Dubai Courts 2" ]
},
    "ExtendedData": {
      "LatLonBox": {
        "north": 25.2511176,
        "south": 25.2448224,
        "east": 55.3225256,
        "west": 55.3162304
      }
    },
    "Point": {
      "coordinates": [ 55.3193780, 25.2479700, 0 ]
    }
  } ]
}

2010-01-07 17:09:41,350 DEBUG Rolling back a_buildings1_dub
2010-01-07 17:09:41,351 DEBUG Closing MungeStep a_buildings1_dub
2010-01-07 17:09:41,351 DEBUG Closing MungeStep Upper Case
2010-01-07 17:09:41,351 DEBUG Closing MungeStep Translate Words
2010-01-07 17:09:41,351 DEBUG Closing MungeStep String constant
2010-01-07 17:09:41,351 DEBUG Closing MungeStep String constant
2010-01-07 17:09:41,352 DEBUG Closing MungeStep Concat
2010-01-07 17:09:41,352 DEBUG Closing MungeStep Google Maps Address Lookup
2010-01-07 17:09:41,352 DEBUG Closing MungeStep a_buildings1_dub
2010-01-07 17:09:41,352 ERROR 0/1: Cleanse Engine failed
2010-01-07 17:09:42,079 ERROR Error during engine run
java.lang.RuntimeException: org.json.JSONException: JSONObject["Country"] not found.
	at ca.sqlpower.matchmaker.CleanseEngineImpl.call(CleanseEngineImpl.java:231)
	at ca.sqlpower.matchmaker.swingui.engine.EngineWorker.doStuff(EngineWorker.java:117)
	at ca.sqlpower.swingui.SPSwingWorker.run(SPSwingWorker.java:60)
	at java.lang.Thread.run(Thread.java:637)
Caused by: org.json.JSONException: JSONObject["Country"] not found.
	at org.json.JSONObject.get(JSONObject.java:422)
	at org.json.JSONObject.getJSONObject(JSONObject.java:516)
	at ca.sqlpower.matchmaker.munge.GoogleAddressLookup.doCall(GoogleAddressLookup.java:146)
	at ca.sqlpower.matchmaker.munge.AbstractMungeStep.call(AbstractMungeStep.java:633)
	at ca.sqlpower.matchmaker.munge.MungeProcessor.call(MungeProcessor.java:100)
	at ca.sqlpower.matchmaker.munge.MungeProcessor.call(MungeProcessor.java:58)
	at ca.sqlpower.matchmaker.CleanseEngineImpl.call(CleanseEngineImpl.java:214)
	... 3 more

Any work-around for this?
I'm using 0.9.5 for OS X and I'm 'build > make > install' phobic

Found a work-around:
1. add the 'Translate Word' step to transformation and save it;
2. open repository table 'mm_munge_step_parameter';
3. add new line to table with:
a. 'munge_step_oid' = step 'munge_step_oid' in 'mm_munge_step'
b. 'parameter_name' = "translateGroupOid";
c. 'parameter_value' = 'translate_group_oid' in 'pl_match_translate_group';

Don't blame me if your repository gets corrupted because of this hack

I also bumped on this.
Any update? Any work-around?

What's the best way to isolate the problem?

Thank you both for your fast replies

However, it seems that was only part of the problem.

It seems the 'text' type fields - varchar(huge_number) - was causing some havoc in architect memory managment.

I had an interesting morning with some java out of memory errors and unexpected windoze system crashes.

Maybe some problems in XP 64bits JRE...

Alas! It's working - for now

Thank you both

Hi!

I'm having some trouble profiling a table in Postgres.

Architect fails silently - doesn't show any results in profile page - but generates error in log file (attached).

Table definition is:

Table is quite large (>4M lines).

Can someone give me a help to work-around this?