* bump version

* rm pip install
Co-authored-by: Ntsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Former-commit-id: f1e94dec265dfc4bfd7e7aa66dfac2525a3910e4

* support __version__

* add license
Co-authored-by: Ntsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Former-commit-id: 2111b4b7

* refine readme

* refine readme

* Update README.md

* refine readme

* refine readme

* Update README.md

* refine readme

Former-commit-id: 4d3a7266

Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Former-commit-id: 4137bb1e

* fix random_mask_like op do not generate random mask in eager mode

* name should be given when seed is not None

Former-commit-id: 19a8bcd3

* modify reduce

* add oneflow log

* cmake support

* fix python code

* fix summary

* put log pb into core/summary dir

* fix import proto

* fix review bug

* add license

* modify test_summary.py

* reformat test_summary.py

* libpng headers

* add dependency

* fix summary

* modify test_summary.py

* set mirroried_strategy

* fix bug

* modify test_summary

* merge develop

* modify test_summary.py

* format test_summaty.py

* change log dir

* fix bug

* fix bug

* reformat

* remove write structure_graph to disk
Co-authored-by: Ntsai <caishenghang@oneflow.org>
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Ncheng cheng <472491134@qq.com>
Former-commit-id: d2c7d2f4

* conv pool padding

* same padding op

* nn ops

* test case

* rm same_padding num_spatial_dims constant_value

* conv pads len ndims+2 -> ndims

* pool pad len ndims+2 -> ndims

* polling dynamic use samepaddingop -> cudnn padding

* add test case

* rm useless

* conv pads -> padding_before

* format

* pool pads_before -> padding_before

* add conv dynamic test case

* pool add test case

* address review

* fix conv cpu dynamic

* fix pool cpu dynamic

* UserKernelOpInferContext tensordesc return nullptr when arg can not find

* fix annotations

* memcopier add CopyElem

* same padding use copyElem

* refine

* add float16

* add gpu fp16

* deconv use padding_before

* same_padding add sbp

* NCHW->NHWC

* test case

* rm useless and format

* ResetIfDynamic->Reset

* compat_conv2d

* set mirrored view

* update pad conversion in onnx (#3327)

* fix tensorrt conv pooling padding

* address review

* address review

* fix
Co-authored-by: Ndaquexian <daquexian566@gmail.com>
Co-authored-by: NShenghang Tsai <jackalcooper@gmail.com>
Co-authored-by: Ncheng cheng <472491134@qq.com>
Former-commit-id: 38459c9e

* add sparse cross entropy op

* sparse_cross_entropy_kernel_util

* add sparse softmax cross entropy op

* prediction_diff->dx

* test pass

* add if ENABLE_USER_OP

* refine code

* fix and add softmax util for build

* Add AlwaysComputeWhenAllOutputsEmpty()

* use TensorDesc and dx->prediction_diff

* address review

* add comment

* sparse cross entropy ms

* reduce max

* fix

* add test

* test ms for non user op

* fix

* merge develop

* merge develop

* use two stage reduce max in sparse softmax loss pass

* refine

* merge develop
Co-authored-by: Nguoran <guoran@oneflow.org>
Former-commit-id: 657f814d

Former-commit-id: ebcd5e4a

* TestEagerAlexNet

* impl eager_checkpoint_load

* update 1node_test

* add eager models node test

* minor modification

* add Eager Integration test

* remove eager integration test workflows
Co-authored-by: Nouyangyu <xuanjiuye@gmail.com>
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Former-commit-id: 78cca0f0

Former-commit-id: 8f3f7838

* adv

* dep

* exp

* img

* onnx

* opt

* place

* rand

* add more
Co-authored-by: Ntsai <caishenghang@oneflow.org>
Former-commit-id: 04e020f1

Co-authored-by: Ntsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Former-commit-id: 9e3dae5b

* refine docstring

* fix doc warning

* fix doc warning

* check in skip

* check in update src

* revert undoc methods

* skip more

* fmt

* add docs

* add new api column in .rsr

* add clean build

* fix tol
Co-authored-by: NFlowingsun007 <flowingsun007@163.com>
Co-authored-by: Ntsai <caishenghang@oneflow.org>
Former-commit-id: b79e6fbc

Former-commit-id: e9ba5d44

* add rel script

* support customized package name

* one wheel dir

* update docs

* add more info

* add more info

* add from img

* fix

* use oneflow_cu102 in ci

* fix

* default rdma OFF

* fix typo
Co-authored-by: Ntsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Co-authored-by: Nguo ran <360112263@qq.com>
Former-commit-id: 4078da22

Co-authored-by: Nguo ran <360112263@qq.com>
Former-commit-id: 02bb9f99

* add cast_like op, reduce maxmin grad

* cast like op

* add sbp

* fix batch axis

* like->dtype_like

Former-commit-id: 60539e30

* memcopier add copynd and copyelem

* address review

* rm 6d test case

Former-commit-id: 88c01352

Former-commit-id: 4b85abcf

Former-commit-id: a7754ab7

* fix the bug of weight_decay params

* fix wrong type annotation

Former-commit-id: 03aeed2a

Former-commit-id: 70d1eead

Former-commit-id: 51bded76

Former-commit-id: 0f55cf84

Former-commit-id: b4c66fb8

* InferLogicalOutBlobDescs

* eager oneflow.advanced.distribute_* works

* set device "gpu" in eager_nccl_all_reduce op_conf

* fix reduce_sum unittest

* replace np.array_equal with np.allclose for tolerating different shape for scalar

Former-commit-id: e0844084

Former-commit-id: 4599308c

Former-commit-id: 24f035a0

* #3196 refactor user op c++ register draft

* #3196 refactor op register c++ api part2

* #3196 refine interface

* #3196 user new get

* #3196 rename

* #3196 finish Op reg

* #3196 finish Op grad reg

* #3196 refine

* #3196 op kernel reg part 1

* #3196 op kernel reg part 2

* #3196 op kernel reg part 3

* #3196 op kernel reg part 4

* #3196 op kernel reg part 5 fix

* #3196 compile & test pass

* #3196 merge branch develop

* #3196 rm useless code

* use new api to rewrite batch norm grad graph

* use new api to rewrite batch norm grad graph fix typo

* use new api to rewrite batch norm grad graph fix typo

* use new api to rewrite where

* implement new interface

* finish BackwardOpConfContext

* finish first version bw_op_gen_context & fw_op interface

* refine lambda fn & interface

* refine lambda var capture in func

* check batch norm & add comment

* batch norm & where finish & pass test

* refine interface of builder fn

* refactor relu grad

* rm relu grad
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Former-commit-id: d0931f35

Former-commit-id: 3ed69eac

* reform to op module

* fix using user_op_module_builder

* change by comment

* fix and update test
Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Former-commit-id: fb107a7a

Former-commit-id: bf621858

Co-authored-by: NLi Xinqi <lixinqi2010@gmail.com>
Former-commit-id: 0d1980b1

Co-authored-by: Ntsai <caishenghang@1f-dev.kbaeegfb1x0ubnoznzequyxzve.bx.internal.cloudapp.net>
Former-commit-id: 1e535df3

* add SetTrainConf api and some implementation of optimizer class

* set functionconfig type in constructor, refactor optimizer classes

* refactor to support lr_lbn, add Adam optimizer, update api_global_function

* make model_update_conf and primary_lr optional

* check model_update_conf and primary_lr

* add other lrschedulers and optimizers

* remove weight_decay, add AdamW, and other minor changes

* add ClipGradientConf

* refine

* refine

* PiecewiseScalingScheduler supports a single scale

* fix copy paste error

* rename val to clip_norm

* move grad_clipping to optimizer namespace, add WarmupConf

* check model_update_conf and primary_lr only when has_train_conf() is true

* support sequence loss, improve type check

* update optimizer in test_util.py

* replace str with Text in type annotations

* reformat

Former-commit-id: 7bc8cd72

* update readme

* python3 -m pip

* colon

* rm required

* To install dependencies, run:

Former-commit-id: e4e631e8

* fix script

* BUILD_RDMA default ON

* add rdma dependency in dockerfile

* fix rm tmp wheel

Former-commit-id: e33bd43d

* add dcgan test

* add 1n4c test for deconv

* multi-gpu result different

* fix merge

* add license

* format

* fix bn

* typo

* remove deconv 1n4c test
Co-authored-by: Njames plur <jamesplur7@gmail.com>
Former-commit-id: 128ccf70

* add dict return type of global function

* remove type judge of OriginFrom

* fix syntax err

* add test script

* fix code style

Former-commit-id: ef395840