 |
Forums |
Admin Discussion Forums: help Start New Thread
By: Jonathan Locker
 Segmentation Fault and other OCI errors [ reply ]
2013-03-05 16:02
|
The setup:
Ruby 1.9.2@p180. Rails 2.3.15
ruby-oci8 2.1.4
activerecord-oracle_enhanced-adapter", '~> 1.2.4'
Oracle Instant Client 11.2
CentOS release 5.8
We have a Rails app which sends messages to a Redis queue. Then we have resque-pool managing resque workers. The Workers load up a large part of Rails so that they can access the database.
Sometimes (but not always), the Workers seem to have database issues. Normally in the case of ORA errors, but recently we saw a segmentation fault. We have tried different versions of the OCI8 driver and instantclient and still are having issues.
Below is a Stack Trace from the Segmentation fault we witnessed yesterday.
Any help on why this is happening would be appreciated.
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8/cursor.rb:536: [BUG] Segmentation fault
ruby 1.9.2p180 (2011-02-18 revision 30909) [x86_64-linux]
-- control frame ----------
c:0081 p:---- s:0328 b:0328 l:000327 d:000327 CFUNC :__fetch
c:0080 p:0014 s:0324 b:0324 l:000323 d:000323 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8/cursor.rb:536
c:0079 p:0057 s:0321 b:0321 l:000320 d:000320 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8/cursor.rb:154
c:0078 p:0132 s:0317 b:0317 l:000316 d:000316 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connect
c:0077 p:0020 s:0304 b:0304 l:001200 d:000303 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connect
c:0076 p:0005 s:0302 b:0302 l:000078 d:000301 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract_a
c:0075 p:0005 s:0300 b:0300 l:000ec8 d:000299 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activesupport-2.3.17/lib/active_support/core_ext/benchmark.rb:17
c:0074 p:0024 s:0298 b:0298 l:000297 d:000297 METHOD /opt/ruby-1.9.2-p180/lib/ruby/1.9.1/benchmark.rb:309
c:0073 p:0013 s:0292 b:0291 l:000ec8 d:000ec8 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activesupport-2.3.17/lib/active_support/core_ext/benchmark.rb:17
c:0072 p:0033 s:0288 b:0288 l:000078 d:000078 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract_a
c:0071 p:0035 s:0279 b:0279 l:000265 d:000278 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/active_rec
c:0070 p:0102 s:0275 b:0275 l:000274 d:000274 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/method_tracer.rb:242
c:0069 p:0190 s:0266 b:0266 l:000265 d:000265 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/active_rec
c:0068 p:0014 s:0256 b:0256 l:000255 d:000255 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connect
c:0067 p:0022 s:0251 b:0251 l:001200 d:001200 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connect
c:0066 p:0018 s:0245 b:0245 l:000244 d:000244 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract/d
c:0065 p:0039 s:0240 b:0240 l:000239 d:000239 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract/q
c:0064 p:0110 s:0236 b:0236 l:000235 d:000235 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connect
c:0063 p:0125 s:0226 b:0226 l:000225 d:000225 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connect
c:0062 p:0053 s:0221 b:0221 l:000220 d:000220 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1305
c:0061 p:0025 s:0218 b:0218 l:000217 d:000217 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1318
c:0060 p:0025 s:0215 b:0215 l:000214 d:000214 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1331
c:0059 p:0009 s:0212 b:0212 l:000199 d:000211 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:2029
c:0058 p:---- s:0209 b:0209 l:000208 d:000208 FINISH
c:0057 p:---- s:0207 b:0207 l:000202 d:000206 IFUNC
c:0056 p:---- s:0205 b:0205 l:000204 d:000204 CFUNC :each
c:0055 p:---- s:0203 b:0203 l:000202 d:000202 CFUNC :all?
c:0054 p:0025 s:0200 b:0200 l:000199 d:000199 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:2029
c:0053 p:0047 s:0196 b:0196 l:000195 d:000195 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1876
c:0052 p:0072 s:0185 b:0185 l:000184 d:000184 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/will_paginate-2.3.16/lib/will_paginate/finder.rb:170
c:0051 p:---- s:0178 b:0178 l:000177 d:000177 FINISH
c:0050 p:0025 s:0176 b:0176 l:000175 d:000175 METHOD /var/www/html/application/current/app/processors/import_app_full_data_download_processor.rb:6
c:0049 p:0092 s:0171 b:0171 l:000170 d:000170 METHOD /var/www/html/application/current/app/processors/application.rb:46
c:0048 p:0014 s:0166 b:0166 l:0011c0 d:000165 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/job.rb:138
c:0047 p:0008 s:0163 b:0163 l:0007e0 d:000162 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/resque.rb:
c:0046 p:0059 s:0161 b:0161 l:000147 d:000160 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/controller
c:0045 p:0102 s:0157 b:0157 l:000156 d:000156 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/method_tracer.rb:242
c:0044 p:0189 s:0148 b:0148 l:000147 d:000147 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/controller
c:0043 p:0032 s:0140 b:0140 l:0007e0 d:0007e0 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/resque.rb:
c:0042 p:0017 s:0136 b:0136 l:0011c0 d:002308 LAMBDA /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/job.rb:137
c:0041 p:---- s:0134 b:0134 l:000133 d:000133 FINISH
c:0040 p:---- s:0132 b:0132 l:000131 d:000131 CFUNC :call
c:0039 p:0129 s:0129 b:0129 l:0011c0 d:0011c0 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/job.rb:145
c:0038 p:0039 s:0121 b:0121 l:000120 d:000120 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/worker.rb:188
c:0037 p:0282 s:0116 b:0116 l:000107 d:000115 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/worker.rb:153
c:0036 p:---- s:0113 b:0113 l:000112 d:000112 FINISH
c:0035 p:---- s:0111 b:0111 l:000110 d:000110 CFUNC :loop
c:0034 p:0044 s:0108 b:0108 l:000107 d:000107 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/worker.rb:133
c:0033 p:0071 s:0102 b:0102 l:000094 d:000101 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:326
c:0032 p:---- s:0100 b:0100 l:000099 d:000099 FINISH
c:0031 p:---- s:0098 b:0098 l:000097 d:000097 CFUNC :fork
c:0030 p:0024 s:0095 b:0095 l:000094 d:000094 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:321
c:0029 p:0012 s:0089 b:0089 l:000080 d:000088 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:300
c:0028 p:---- s:0086 b:0086 l:000085 d:000085 FINISH
c:0027 p:---- s:0084 b:0084 l:000083 d:000083 CFUNC :times
c:0026 p:0019 s:0081 b:0081 l:000080 d:000080 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:299
c:0025 p:0036 s:0077 b:0077 l:000067 d:000076 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:285
c:0024 p:---- s:0073 b:0073 l:000072 d:000072 FINISH
c:0023 p:---- s:0071 b:0071 l:000070 d:000070 CFUNC :each
c:0022 p:0017 s:0068 b:0068 l:000067 d:000067 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:283
c:0021 p:0043 s:0065 b:0065 l:000064 d:000064 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:198
c:0020 p:0069 s:0062 b:0062 l:000061 d:000061 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:72
c:0019 p:0029 s:0059 b:0059 l:001a78 d:000058 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool/tasks.rb:17
c:0018 p:---- s:0057 b:0057 l:000056 d:000056 FINISH
c:0017 p:---- s:0055 b:0055 l:000054 d:000054 CFUNC :call
c:0016 p:0043 s:0050 b:0050 l:000041 d:000049 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:636
c:0015 p:---- s:0047 b:0047 l:000046 d:000046 FINISH
c:0014 p:---- s:0045 b:0045 l:000044 d:000044 CFUNC :each
c:0013 p:0171 s:0042 b:0042 l:000041 d:000041 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:631
c:0012 p:0110 s:0038 b:0038 l:000032 d:000037 BLOCK /var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:597
c:0011 p:0019 s:0036 b:0036 l:000035 d:000035 METHOD /opt/ruby-1.9.2-p180/lib/ruby/1.9.1/monitor.rb:201
c:0010 p:0033 s:0033 b:0033 l:000032 d:000032 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:590
c:0009 p:0048 s:0027 b:0027 l:000026 d:000026 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:583
c:0008 p:0095 s:0022 b:0022 l:000021 d:000021 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool/cli.rb:114
c:0007 p:0080 s:0019 b:0019 l:000018 d:000018 METHOD /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool/cli.rb:16
c:0006 p:0059 s:0015 b:0015 l:000014 d:000014 TOP /var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/bin/resque-pool:7
c:0005 p:---- s:0013 b:0013 l:000012 d:000012 FINISH
c:0004 p:---- s:0011 b:0011 l:000010 d:000010 CFUNC :load
c:0003 p:0127 s:0007 b:0007 l:000a48 d:001890 EVAL /var/www/html/application/shared/bundle/ruby/1.9.1/bin/resque-pool:19
c:0002 p:---- s:0004 b:0004 l:000003 d:000003 FINISH
c:0001 p:0000 s:0002 b:0002 l:000a48 d:000a48 TOP
---------------------------
-- Ruby level backtrace information ----------------------------------------
/var/www/html/application/shared/bundle/ruby/1.9.1/bin/resque-pool:19:in `<main>'
/var/www/html/application/shared/bundle/ruby/1.9.1/bin/resque-pool:19:in `load'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/bin/resque-pool:7:in `<top (required)>'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool/cli.rb:16:in `run'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool/cli.rb:114:in `start_pool'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:583:in `invoke'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:590:in `invoke_with_call_chain'
/opt/ruby-1.9.2-p180/lib/ruby/1.9.1/monitor.rb:201:in `mon_synchronize'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:597:in `block in invoke_with_call_chain'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:631:in `execute'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:631:in `each'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:636:in `block in execute'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/rake-0.8.7/lib/rake.rb:636:in `call'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool/tasks.rb:17:in `block (2 levels) in <top (required)>'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:72:in `run'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:198:in `start'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:283:in `maintain_worker_count'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:283:in `each'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:285:in `block in maintain_worker_count'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:299:in `spawn_missing_workers_for'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:299:in `times'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:300:in `block in spawn_missing_workers_for'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:321:in `spawn_worker!'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:321:in `fork'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-pool-0.3.0/lib/resque/pool.rb:326:in `block in spawn_worker!'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/worker.rb:133:in `work'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/worker.rb:133:in `loop'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/worker.rb:153:in `block in work'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/worker.rb:188:in `perform'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/job.rb:145:in `perform'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/job.rb:145:in `call'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/job.rb:137:in `block (2 levels) in perform'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/resque.rb:29:in `around_perform_with_monitoring'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/controller_instrumentation.rb:263:in `perform_action_with_newrelic_trace'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/method_tracer.rb:242:in `trace_execution_scoped'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/controller_instrumentation.rb:268:in `block in perform_action_with_newrelic_trace'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/resque.rb:30:in `block in around_perform_with_monitoring'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/resque-1.23.0/lib/resque/job.rb:138:in `block (3 levels) in perform'
/var/www/html/application/current/app/processors/application.rb:46:in `perform'
/var/www/html/application/current/app/processors/import_app_full_data_download_processor.rb:6:in `delegated_on_message'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/will_paginate-2.3.16/lib/will_paginate/finder.rb:170:in `method_missing_with_paginate'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1876:in `method_missing'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:2029:in `all_attributes_exists?'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:2029:in `all?'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:2029:in `each'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:2029:in `block in all_attributes_exists?'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1331:in `column_methods_hash'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1318:in `column_names'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/base.rb:1305:in `columns'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connection_adapters/oracle_enhanced_adapter.rb:874:in `columns'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connection_adapters/oracle_enhanced_adapter.rb:903:in `columns_without_cache'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract/query_cache.rb:62:in `select_all_with_query_cache'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract/database_statements.rb:7:in `select_all'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connection_adapters/oracle_enhanced_adapter.rb:1487:in `select'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connection_adapters/oracle_enhanced_adapter.rb:1591:in `log'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/active_record.rb:29:in `log_with_newrelic_instrumentation'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/method_tracer.rb:242:in `trace_execution_scoped'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/newrelic_rpm-3.5.3.25/lib/new_relic/agent/instrumentation/active_record.rb:32:in `block in log_with_newrelic_instrumentation'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract_adapter.rb:206:in `log'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activesupport-2.3.17/lib/active_support/core_ext/benchmark.rb:17:in `ms'
/opt/ruby-1.9.2-p180/lib/ruby/1.9.1/benchmark.rb:309:in `realtime'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activesupport-2.3.17/lib/active_support/core_ext/benchmark.rb:17:in `block in ms'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-2.3.17/lib/active_record/connection_adapters/abstract_adapter.rb:206:in `block in log'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connection_adapters/oracle_enhanced_adapter.rb:1488:in `block in select'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/activerecord-oracle_enhanced-adapter-1.2.4/lib/active_record/connection_adapters/oracle_enhanced_oci_connection.rb:110:in `select'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8/cursor.rb:154:in `fetch'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8/cursor.rb:536:in `fetch_one_row_as_array'
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8/cursor.rb:536:in `__fetch'
-- C level backtrace information -------------------------------------------
resque-1.23.0: Processing full_import since 1362426077(rb_vm_bugreport+0x4f) [0x4e9fbf]
resque-1.23.0: Processing full_import since 1362426077 [0x51be2e]
resque-1.23.0: Processing full_import since 1362426077(rb_bug+0xb1) [0x51bf91]
resque-1.23.0: Processing full_import since 1362426077 [0x493bbf]
/lib64/libpthread.so.0 [0x3ee100ebe0]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(kgghash+0x6b) [0x3faf8a7af7]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(kwfcmfs+0x40) [0x3fae9a3604]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(ttcaGetCol+0x31a) [0x3faf8694ba]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(ttccfpg+0x28e) [0x3faf868b62]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(ttcfour+0x3e8) [0x3faf866e90]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(ttcdrv+0x37d1) [0x3faf85df45]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(nioqwa+0x3d) [0x3faf807481]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(upirtrc+0x569) [0x3faf7f5191]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(kpurcsc+0x62) [0x3faf7fb7e2]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(kpufch0+0x7ba) [0x3fadcf2b88]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(kpufch+0x5ef) [0x3fadcf110f]
/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1(OCIStmtFetch+0xf) [0x3fadc86a03]
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8lib_191.so [0x2aaaae0b782c]
resque-1.23.0: Processing full_import since 1362426077(rb_thread_blocking_region+0x89) [0x4efbe9]
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8lib_191.so(oci8_call_without_gvl+0x126) [0x2aaaae0a2736]
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8lib_191.so(oci8_OCIStmtFetch_nb+0x30) [0x2aaaae0b6d50]
/var/www/html/application/shared/bundle/ruby/1.9.1/gems/ruby-oci8-2.1.4/lib/oci8lib_191.so [0x2aaaae0a87a8]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077(rb_yield_values2+0x37) [0x4e6e57]
resque-1.23.0: Processing full_import since 1362426077 [0x5169de]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6848]
resque-1.23.0: Processing full_import since 1362426077(rb_yield+0x44) [0x4e6eb4]
resque-1.23.0: Processing full_import since 1362426077(rb_ary_each+0x3c) [0x4f4b5c]
resque-1.23.0: Processing full_import since 1362426077 [0x4db23c]
resque-1.23.0: Processing full_import since 1362426077(rb_iterate+0xc8) [0x4d80d8]
resque-1.23.0: Processing full_import since 1362426077(rb_block_call+0x29) [0x4d8289]
resque-1.23.0: Processing full_import since 1362426077 [0x514eaf]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4db125]
resque-1.23.0: Processing full_import since 1362426077 [0x4ddda4]
resque-1.23.0: Processing full_import since 1362426077 [0x4de257]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077(rb_vm_invoke_proc+0x9f) [0x4e6aef]
resque-1.23.0: Processing full_import since 1362426077 [0x41af9a]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6b98]
resque-1.23.0: Processing full_import since 1362426077(rb_rescue2+0x1d9) [0x417bd9]
resque-1.23.0: Processing full_import since 1362426077 [0x4d9029]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077(rb_yield+0x80) [0x4e6ef0]
resque-1.23.0: Processing full_import since 1362426077(rb_protect+0xdd) [0x41796d]
resque-1.23.0: Processing full_import since 1362426077 [0x4648f6]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077(rb_yield+0x44) [0x4e6eb4]
resque-1.23.0: Processing full_import since 1362426077 [0x43ba38]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077(rb_yield+0x44) [0x4e6eb4]
resque-1.23.0: Processing full_import since 1362426077(rb_ary_each+0x3c) [0x4f4b5c]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077(rb_vm_invoke_proc+0x9f) [0x4e6aef]
resque-1.23.0: Processing full_import since 1362426077 [0x41af9a]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077 [0x4e6708]
resque-1.23.0: Processing full_import since 1362426077(rb_yield+0x44) [0x4e6eb4]
resque-1.23.0: Processing full_import since 1362426077(rb_ary_each+0x3c) [0x4f4b5c]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077(rb_iseq_eval+0x161) [0x4e6221]
resque-1.23.0: Processing full_import since 1362426077 [0x51d9ab]
resque-1.23.0: Processing full_import since 1362426077 [0x51dafc]
resque-1.23.0: Processing full_import since 1362426077 [0x4de31e]
resque-1.23.0: Processing full_import since 1362426077 [0x4e124f]
resque-1.23.0: Processing full_import since 1362426077 [0x4e5edf]
resque-1.23.0: Processing full_import since 1362426077(rb_iseq_eval_main+0xa9) [0x4e6089]
resque-1.23.0: Processing full_import since 1362426077 [0x41852f]
resque-1.23.0: Processing full_import since 1362426077(ruby_exec_node+0x19) [0x418559]
resque-1.23.0: Processing full_import since 1362426077(ruby_run_node+0x2f) [0x419b5f]
resque-1.23.0: Processing full_import since 1362426077(main+0x4d) [0x416eed]
/lib64/libc.so.6(__libc_start_main+0xf4) [0x3ee081d994]
resque-1.23.0: Processing full_import since 1362426077 [0x416de9]
[NOTE]
You may have encountered a bug in the Ruby interpreter or extension libraries.
Bug reports are welcome.
For details: http://www.ruby-lang.org/bugreport.html
|
|
|
