• rocking5566's avatar
    Group norm (#417) · 4eba345f
    rocking5566 authored
    
    
    * Add groupnorm example by layernorm
    1.  Reference is not ready
    2. shape of gamma and beta need to be fix
    
    * Let shape of gamma and beta can be same as x
    
    * Modify test, instance and client example
    
    * [What] Fix bug of layernorm for greater than 2 dimension.
    [Why] We need to get upper length from merge transform instead of embed transform.
    
    * Add reference for groupnorm
    
    * Fuse sigmoid after groupnorm
    
    * [What] Rename original layernorm into layernorm2d
    [Why] Prepare to add groupnorm using layernorm5d
    
    * clang-format
    
    * Add groupnorm test
    
    * Refine error message
    
    * Add groupnorm ckProfiler
    
    * Test groupnorm kernel from device_instance
    
    * update example
    
    * upadte profiler
    
    * Fix test naming
    
    * Fix argc number
    
    * Move descriptor and sweeponce to argument for quick debugging
    Co-authored-by: default avatarChao Liu <chao.liu2@amd.com>
    4eba345f
layernorm2d.cpp 6.28 KB