Issue metadata
Sign in to add a comment
|
40.7% regression in service_worker.service_worker_micro_benchmark at 455916:456010 |
||||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Mar 17 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8984898874054074000
,
Mar 17 2017
,
Mar 17 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: winx64intel_perf_bisect Benchmark : service_worker.service_worker_micro_benchmark Metric : concurrent_1_response_90_percentile/concurrent_1_response_90_percentile Revision Result N chromium@455915 0.88619 +- 0.119353 21 good chromium@456010 0.876429 +- 0.0711136 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests service_worker.service_worker_micro_benchmark Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8984898874054074000 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=6441420665126912 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Mar 17 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8984895375162865120
,
Mar 17 2017
=== BISECT JOB RESULTS === NO Perf regression found Bisect Details Configuration: winx64intel_perf_bisect Benchmark : service_worker.service_worker_micro_benchmark Metric : concurrent_1_response_90_percentile/concurrent_1_response_90_percentile Revision Result N chromium@454977 1.16095 +- 0.585987 21 good chromium@456010 1.1119 +- 0.489616 21 bad To Run This Test src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests service_worker.service_worker_micro_benchmark Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8984895375162865120 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5286170293960704 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Mar 27 2017
(bug triaging rotation) The variance of the microbench and also the reference looks increased on Mar 8-10. I guess it might be caused by some infra change, and it was strongly effective for the test. Does anyone know if there was such change?
,
Mar 27 2017
Summary: yes, there was a GPU change, I think this is related to bug 688558 . Here is GPU info from stdout from a run before/after the variance increased: Before: https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FWin_7_Intel_GPU_Perf%2F486%2F%2B%2Frecipes%2Fsteps%2Fservice_worker.service_worker_micro_benchmark_on_Intel_GPU_on_Windows_on_Windows-2008ServerR2-SP1%2F0%2Fstdout INFO:root:OS: win win7 INFO:root:GPU device 0: VENDOR = 0x0, DEVICE = 0x0 INFO:root:GPU Attributes: INFO:root: amd_switchable : False INFO:root: basic_info_state : 2 INFO:root: context_info_state : 2 INFO:root: direct_rendering : True INFO:root: driver_date : INFO:root: driver_vendor : INFO:root: driver_version : INFO:root: dx_diagnostics_info_state: 2 INFO:root: gl_extensions : INFO:root: gl_renderer : INFO:root: gl_reset_notification_strategy: 0 INFO:root: gl_vendor : INFO:root: gl_version : INFO:root: gl_ws_extensions : INFO:root: gl_ws_vendor : INFO:root: gl_ws_version : INFO:root: in_process_gpu : True INFO:root: initialization_time : 0 INFO:root: jpeg_decode_accelerator_supported: False INFO:root: max_msaa_samples : INFO:root: optimus : False INFO:root: passthrough_cmd_decoder: False INFO:root: pixel_shader_version: INFO:root: process_crash_count : 0 INFO:root: sandboxed : False INFO:root: software_rendering : False INFO:root: vertex_shader_version: INFO:root: video_decode_accelerator_flags: 0 INFO:root:Feature Status: INFO:root: 2d_canvas : unavailable_software INFO:root: flash_3d : unavailable_software INFO:root: flash_stage3d : unavailable_software INFO:root: flash_stage3d_baseline: unavailable_software INFO:root: gpu_compositing : unavailable_software INFO:root: multiple_raster_threads: unavailable_off INFO:root: native_gpu_memory_buffers: disabled_software INFO:root: rasterization : unavailable_software INFO:root: video_decode : unavailable_software INFO:root: video_encode : unavailable_software INFO:root: vpx_decode : unavailable_software INFO:root: webgl : unavailable_off INFO:root: webgl2 : unavailable_off INFO:root:Driver Bug Workarounds: INFO:root: clear_uniforms_before_first_program_use INFO:root: decode_encode_srgb_for_generatemipmap INFO:root: disable_direct_composition INFO:root: disable_discard_framebuffer INFO:root: disable_dxgi_zero_copy_video INFO:root: disable_framebuffer_cmaa INFO:root: exit_on_context_lost INFO:root: scalarize_vec_and_mat_constructor_args After: https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FWin_7_Intel_GPU_Perf%2F499%2F%2B%2Frecipes%2Fsteps%2Fservice_worker.service_worker_micro_benchmark_on_Intel_GPU_on_Windows_on_Windows-2008ServerR2-SP1%2F0%2Fstdout INFO:root:OS: win win7 INFO:root:GPU device 0: VENDOR = 0x8086 (Intel), DEVICE = 0x41a INFO:root:GPU device 1: VENDOR = 0x102b, DEVICE = 0x522 INFO:root:GPU Attributes: INFO:root: amd_switchable : False INFO:root: basic_info_state : 1 INFO:root: context_info_state : 1 INFO:root: direct_rendering : True INFO:root: driver_date : 3-23-2016 INFO:root: driver_vendor : Intel Corporation INFO:root: driver_version : 10.18.14.4414 INFO:root: dx_diagnostics_info_state: 0 INFO:root: encrypted_only : False INFO:root: gl_extensions : GL_ANGLE_client_arrays GL_ANGLE_depth_texture GL_ANGLE_framebuffer_blit GL_ANGLE_framebuffer_multisample GL_ANGLE_instanced_arrays GL_ANGLE_lossy_etc_decode GL_ANGLE_pack_reverse_row_order GL_ANGLE_request_extension GL_ANGLE_robust_client_memory GL_ANGLE_robust_resource_initialization GL_ANGLE_texture_compression_dxt3 GL_ANGLE_texture_compression_dxt5 GL_ANGLE_texture_usage GL_ANGLE_translated_shader_source GL_CHROMIUM_bind_generates_resource GL_CHROMIUM_bind_uniform_location GL_CHROMIUM_copy_compressed_texture GL_CHROMIUM_copy_texture GL_CHROMIUM_sync_query GL_EXT_blend_minmax GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_EXT_debug_marker GL_EXT_discard_framebuffer GL_EXT_disjoint_timer_query GL_EXT_draw_buffers GL_EXT_frag_depth GL_EXT_map_buffer_range GL_EXT_occlusion_query_boolean GL_EXT_read_format_bgra GL_EXT_robustness GL_EXT_sRGB GL_EXT_shader_texture_lod GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc_srgb GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_texture_norm16 GL_EXT_texture_rg GL_EXT_texture_storage GL_EXT_unpack_subimage GL_KHR_debug GL_NV_EGL_stream_consumer_external GL_NV_fence GL_NV_pack_subimage GL_NV_pixel_buffer_object GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth32 GL_OES_element_index_uint GL_OES_get_program_binary GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_rgb8_rgba8 GL_OES_standard_derivatives GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_OES_texture_npot GL_OES_vertex_array_object INFO:root: gl_renderer : ANGLE (Intel(R) HD Graphics P4600/P4700 Direct3D11 vs_5_0 ps_5_0) INFO:root: gl_reset_notification_strategy: 33362 INFO:root: gl_vendor : Google Inc. INFO:root: gl_version : OpenGL ES 3.0 (ANGLE 2.1.0.b5e997fbe7d9) INFO:root: gl_ws_extensions : EGL_EXT_create_context_robustness EGL_ANGLE_d3d_share_handle_client_buffer EGL_ANGLE_d3d_texture_client_buffer EGL_ANGLE_surface_d3d_texture_2d_share_handle EGL_ANGLE_query_surface_pointer EGL_ANGLE_window_fixed_size EGL_ANGLE_keyed_mutex EGL_ANGLE_surface_orientation EGL_NV_post_sub_buffer EGL_KHR_create_context EGL_EXT_device_query EGL_KHR_image EGL_KHR_image_base EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_gl_renderbuffer_image EGL_KHR_get_all_proc_addresses EGL_KHR_stream EGL_KHR_stream_consumer_gltexture EGL_NV_stream_consumer_gltexture_yuv EGL_ANGLE_flexible_surface_compatibility EGL_ANGLE_create_context_webgl_compatibility EGL_CHROMIUM_create_context_bind_generates_resource EGL_EXT_pixel_format_float EGL_ANGLE_display_texture_share_group EGL_ANGLE_create_context_client_arrays EGL_ANGLE_create_context_robust_resource_initialization INFO:root: gl_ws_vendor : Google Inc. (adapter LUID: 00000000000058c0) INFO:root: gl_ws_version : 1.4 (ANGLE 2.1.0.b5e997fbe7d9) INFO:root: in_process_gpu : False INFO:root: initialization_time : 1.141449 INFO:root: jpeg_decode_accelerator_supported: False INFO:root: max_msaa_samples : 8 INFO:root: max_resolution_height: 1088 INFO:root: max_resolution_width: 1920 INFO:root: min_resolution_height: 48 INFO:root: min_resolution_width: 48 INFO:root: optimus : False INFO:root: passthrough_cmd_decoder: False INFO:root: pixel_shader_version: 5.0 INFO:root: process_crash_count : 0 INFO:root: profile : 3 INFO:root: sandboxed : False INFO:root: software_rendering : False INFO:root: vertex_shader_version: 5.0 INFO:root: video_decode_accelerator_flags: 0 INFO:root:Feature Status: INFO:root: 2d_canvas : enabled INFO:root: flash_3d : enabled INFO:root: flash_stage3d : enabled INFO:root: flash_stage3d_baseline: enabled INFO:root: gpu_compositing : enabled INFO:root: multiple_raster_threads: enabled_on INFO:root: native_gpu_memory_buffers: disabled_software INFO:root: rasterization : enabled INFO:root: video_decode : enabled INFO:root: video_encode : enabled INFO:root: vpx_decode : unavailable_software INFO:root: webgl : enabled INFO:root: webgl2 : enabled INFO:root:Driver Bug Workarounds: INFO:root: clear_uniforms_before_first_program_use INFO:root: decode_encode_srgb_for_generatemipmap INFO:root: disable_direct_composition INFO:root: disable_discard_framebuffer INFO:root: disable_dxgi_zero_copy_video INFO:root: disable_framebuffer_cmaa INFO:root: exit_on_context_lost INFO:root: force_cube_complete INFO:root: msaa_is_slow INFO:root: scalarize_vec_and_mat_constructor_args INFO:root: texsubimage_faster_than_teximage
,
Mar 28 2017
Thanks! Let me mark this issue as WONTFIX.
,
Apr 11 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8982624404649495104
,
Apr 11 2017
=== BISECT JOB RESULTS === Perf regression found but unable to narrow commit range Build failures prevented the bisect from narrowing the range further. Bisect Details Configuration: winx64intel_perf_bisect Benchmark : service_worker.service_worker_micro_benchmark Metric : concurrent_1_response_90_percentile/concurrent_1_response_90_percentile Change : 2.73% | 0.895555555556 -> 0.871111111111 Suspected Commit Range 2 commits in range https://chromium.googlesource.com/chromium/src/+log/b348620b14101e7861728a3876f66ef8d964a846..5e921f820bc0a86566e25b279019ba965535230e Revision Result N chromium@454977 0.895556 +- 0.0788811 9 good chromium@455494 0.887308 +- 0.0445058 13 good chromium@455623 0.900556 +- 0.06101 9 good chromium@455688 0.890714 +- 0.0440779 14 good chromium@455705 0.894524 +- 0.0839359 21 good chromium@455713 0.890769 +- 0.0451919 13 good chromium@455717 0.893214 +- 0.0450595 14 good chromium@455718 0.893333 +- 0.0182574 6 good chromium@455719 --- --- build failure chromium@455720 0.877857 +- 0.0358569 14 bad chromium@455752 0.866111 +- 0.0398609 9 bad chromium@456010 0.871111 +- 0.0329983 9 bad To Run This Test src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests service_worker.service_worker_micro_benchmark Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8982624404649495104 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5286170293960704 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you! |
|||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||
Comment 1 by nhiroki@chromium.org
, Mar 17 2017