Skip to content

Dispatcher improvements #23

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
akodanka wants to merge 11 commits into
base: master
Choose a base branch
from
Draft

Dispatcher improvements #23

akodanka wants to merge 11 commits into from

Conversation

@akodanka
Copy link

@akodanka akodanka commented May 17, 2023

Improvements for remote inference using dispatcher.

rairatne and others added 3 commits May 12, 2023 04:41
@rairatne
Compatibility changes to build nn-hal for Android R
c659f9e 
Tracked-On: OAM-105850
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
Signed-off-by: Ratnesh Kumar Rai <ratnesh.kumar.rai@intel.com>
Signed-off-by: Jaikrishna, Nemallapudi <nemallapudi.jaikrishna@intel.com>
@akodanka
Disable parallel attempts for remote inference
a13d58f 
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@rairatne @akodanka
Added load model and data_type for remote infer
bb639c9 
loadmodel rpc call added after sending IR files
Included data_type parameter for input data

Tracked-On: OAM-109729
Signed-off-by: Ratnesh Kumar Rai <ratnesh.kumar.rai@intel.com>
@sysopenci
Copy link

sysopenci commented May 17, 2023

Expected syntax:
Commit message one-line summary

  Extra paragraphs can be added here.

  Longer description that explains the problem / solution
  or whatever that needs to be said

  It can contain
    multiple lines
    multiple paragraphs
    blank lines
    references

  But each paragraph must be followed by a blank line

  However, you need to keep the 'Tracked-On', 'Change-Id',
  'Signed-off-by', ..., fields in the **lastest** paragraph of
  the commit message.

  Change-Id: I9e58f79c7faf7f0edb9792e8b5322ab161331141
  Tracked-On: https://jira.server.ext/browse/PROJECTA-123
  Signed-off-by: Developer Name <developer.name@intel.com>

@sysopenci
Copy link

sysopenci commented May 18, 2023

Expected syntax:
Commit message one-line summary

  Extra paragraphs can be added here.

  Longer description that explains the problem / solution
  or whatever that needs to be said

  It can contain
    multiple lines
    multiple paragraphs
    blank lines
    references

  But each paragraph must be followed by a blank line

  However, you need to keep the 'Tracked-On', 'Change-Id',
  'Signed-off-by', ..., fields in the **lastest** paragraph of
  the commit message.

  Change-Id: I9e58f79c7faf7f0edb9792e8b5322ab161331141
  Tracked-On: https://jira.server.ext/browse/PROJECTA-123
  Signed-off-by: Developer Name <developer.name@intel.com>

@akodanka akodanka force-pushed the dispatcher_improvements branch from 701f5d9 to ddb22bb Compare May 18, 2023 06:32
@sysopenci
Copy link

sysopenci commented May 18, 2023

Expected syntax:
Commit message one-line summary

  Extra paragraphs can be added here.

  Longer description that explains the problem / solution
  or whatever that needs to be said

  It can contain
    multiple lines
    multiple paragraphs
    blank lines
    references

  But each paragraph must be followed by a blank line

  However, you need to keep the 'Tracked-On', 'Change-Id',
  'Signed-off-by', ..., fields in the **lastest** paragraph of
  the commit message.

  Change-Id: I9e58f79c7faf7f0edb9792e8b5322ab161331141
  Tracked-On: https://jira.server.ext/browse/PROJECTA-123
  Signed-off-by: Developer Name <developer.name@intel.com>

@akodanka
Enable debug logs
ab8325e 
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@akodanka akodanka force-pushed the dispatcher_improvements branch from ddb22bb to 5b68971 Compare May 19, 2023 10:05
akodanka added 3 commits May 19, 2023 10:10
@akodanka
Increase GRPC message size and improved remote checks
049e0ab 
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@akodanka
Disable remote inference if a request fails
8d79a9f 
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@akodanka
Parallel Remote Inference
1edfa46 
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@akodanka akodanka force-pushed the dispatcher_improvements branch from 5b68971 to 1edfa46 Compare May 19, 2023 10:10
rairatne and others added 4 commits May 19, 2023 12:43
@rairatne @akodanka
Resolved quant type conversion issue
2028a85 
Signed-off-by: Ratnesh Kumar Rai <ratnesh.kumar.rai@intel.com>
@akodanka
Prevent non-compliant upcast of model, operand
cf8489f 
Fix the following errors :
Upcasting non-compliant model
Upcasting non-compliant operand type TENSOR_QUANT8_ASYMM_SIGNED from V1_3::OperandType to V1_2::OperandType

Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@akodanka
Background remote model load
1b87c16 
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@akodanka
Separate ModelInfo objects for each operation
47e0c52 
Signed-off-by: Anoob Anto K <anoob.anto.kodankandath@intel.com>
@sysopenci sysopenci added the Stale Stale label for inactive open prs label Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

Invalid commit message Stale Stale label for inactive open prs

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@akodanka @sysopenci @rairatne