Edge for scientific research session on September 13 Edge WG meeting
Hi, I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions. Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge! The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings Please find the details of the session below. Thanks and Best Regards, Ildikó Title: Chameleon: a cloud to edge infrastructure for science Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Hi, It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project. During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap. The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented. The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting. Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Hi Ildiko, Currently Cyborg and nova support interaction, we are not very familiar with zun yet, if possible, please provide some relevant information. You can refer to [1] for Cyborg related materials, and [2] for the interactive content of nova and cyborg (not yet merged). [1]https://docs.openstack.org/cyborg/latest/user/architecture.html [2]https://review.opendev.org/c/openstack/cyborg/+/794549 https://specs.openstack.org/openstack/nova-specs/specs/ussuri/implemented/no... Bailin Zhang (brinzhang) -----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年8月31日 22:39 收件人: openstack-discuss <openstack-discuss@lists.openstack.org> 主题: [lists.openstack.org代发][zun][cyborg][kuryr] Re: Edge for scientific research session on September 13 Edge WG meeting Hi, It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project. During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap. The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented. The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting. Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Hi Bailin, Thank you for sharing the links. Zun is the project in OpenStack that is supporting to run and manage containers directly from OpenStack without the need of Kubernetes. As the Chameleon project is using it to run their containerized workload and they also need hardware accelerators they integrated it with Cyborg. Many of their activities fall under the edge computing area and they are starting their collaboration with the OpenInfra Edge Computing group for this reason. As part of that work we are helping them to reach relevant communities and project teams where their requirements identified some gaps and I believe the Cyborg-Zun integration is one of these. They would like to upstream their work if the community finds value in it as it may or may not fall into the current scope of the respective projects. I hope that we can start to discuss some of this on the meeting next Monday and take next steps from there. I hope this helps a bit with the context and we can have a fruitful discussion next week. I will share the recording of the meeting as soon as it is available in case someone would not be able to make it and would like to check out the presentation and the discussion that follows. Thanks, Ildikó
On Sep 3, 2021, at 04:20, Brin Zhang(张百林) <zhangbailin@inspur.com> wrote:
Hi Ildiko,
Currently Cyborg and nova support interaction, we are not very familiar with zun yet, if possible, please provide some relevant information. You can refer to [1] for Cyborg related materials, and [2] for the interactive content of nova and cyborg (not yet merged).
[1]https://docs.openstack.org/cyborg/latest/user/architecture.html [2]https://review.opendev.org/c/openstack/cyborg/+/794549 https://specs.openstack.org/openstack/nova-specs/specs/ussuri/implemented/no...
Bailin Zhang (brinzhang)
-----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年8月31日 22:39 收件人: openstack-discuss <openstack-discuss@lists.openstack.org> 主题: [lists.openstack.org代发][zun][cyborg][kuryr] Re: Edge for scientific research session on September 13 Edge WG meeting
Hi,
It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project.
During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap.
The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented.
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting.
Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
I will share the recording of the meeting as soon as it is available in case someone would not be able to make it and would like to check out the presentation and the discussion that follows. Thanks for you will share of the record, at 1300UTC I have another meeting (start 1100UTC), if I can end up that meeting earlier, I will join this meeting ^^
brinzhang -----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年9月8日 6:08 收件人: Brin Zhang(张百林) <zhangbailin@inspur.com> 抄送: openstack-discuss@lists.openstack.org; xin-ran.wang@intel.com 主题: Re: [lists.openstack.org代发][zun][cyborg][kuryr] Edge for scientific research session on September 13 Edge WG meeting Hi Bailin, Thank you for sharing the links. Zun is the project in OpenStack that is supporting to run and manage containers directly from OpenStack without the need of Kubernetes. As the Chameleon project is using it to run their containerized workload and they also need hardware accelerators they integrated it with Cyborg. Many of their activities fall under the edge computing area and they are starting their collaboration with the OpenInfra Edge Computing group for this reason. As part of that work we are helping them to reach relevant communities and project teams where their requirements identified some gaps and I believe the Cyborg-Zun integration is one of these. They would like to upstream their work if the community finds value in it as it may or may not fall into the current scope of the respective projects. I hope that we can start to discuss some of this on the meeting next Monday and take next steps from there. I hope this helps a bit with the context and we can have a fruitful discussion next week. I will share the recording of the meeting as soon as it is available in case someone would not be able to make it and would like to check out the presentation and the discussion that follows. Thanks, Ildikó
On Sep 3, 2021, at 04:20, Brin Zhang(张百林) <zhangbailin@inspur.com> wrote:
Hi Ildiko,
Currently Cyborg and nova support interaction, we are not very familiar with zun yet, if possible, please provide some relevant information. You can refer to [1] for Cyborg related materials, and [2] for the interactive content of nova and cyborg (not yet merged).
[1]https://docs.openstack.org/cyborg/latest/user/architecture.html [2]https://review.opendev.org/c/openstack/cyborg/+/794549 https://specs.openstack.org/openstack/nova-specs/specs/ussuri/implemented/no...
Bailin Zhang (brinzhang)
-----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年8月31日 22:39 收件人: openstack-discuss <openstack-discuss@lists.openstack.org> 主题: [lists.openstack.org代发][zun][cyborg][kuryr] Re: Edge for scientific research session on September 13 Edge WG meeting
Hi,
It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project.
During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap.
The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented.
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting.
Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Hi, We had a great session today, thanks to all of you who tuned in. For those of you who couldn’t make it, we have a recording of the presentation and the discussion that followed: https://wiki.openstack.org/wiki/Edge_Computing_Group#CHI.40Edge_-_recording_... Next steps we touched on: * Chameleon integrated Cyborg and Zun ad would like to look into how to upstream that work * Uploading a spec about the integration steps * Discussing the details at the PTG * Chameleon also added a new Neutron ML2 plugin to support Wireguard; it could be a good item to discuss with the Neutron team as well to check upstream potential and make improvements to the agent Please let me know if you have questions to either of the above. Thanks and Best Regards, Ildikó
On Sep 7, 2021, at 17:15, Brin Zhang(张百林) <zhangbailin@inspur.com> wrote:
I will share the recording of the meeting as soon as it is available in case someone would not be able to make it and would like to check out the presentation and the discussion that follows. Thanks for you will share of the record, at 1300UTC I have another meeting (start 1100UTC), if I can end up that meeting earlier, I will join this meeting ^^
brinzhang
-----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年9月8日 6:08 收件人: Brin Zhang(张百林) <zhangbailin@inspur.com> 抄送: openstack-discuss@lists.openstack.org; xin-ran.wang@intel.com 主题: Re: [lists.openstack.org代发][zun][cyborg][kuryr] Edge for scientific research session on September 13 Edge WG meeting
Hi Bailin,
Thank you for sharing the links.
Zun is the project in OpenStack that is supporting to run and manage containers directly from OpenStack without the need of Kubernetes. As the Chameleon project is using it to run their containerized workload and they also need hardware accelerators they integrated it with Cyborg.
Many of their activities fall under the edge computing area and they are starting their collaboration with the OpenInfra Edge Computing group for this reason. As part of that work we are helping them to reach relevant communities and project teams where their requirements identified some gaps and I believe the Cyborg-Zun integration is one of these. They would like to upstream their work if the community finds value in it as it may or may not fall into the current scope of the respective projects.
I hope that we can start to discuss some of this on the meeting next Monday and take next steps from there.
I hope this helps a bit with the context and we can have a fruitful discussion next week.
I will share the recording of the meeting as soon as it is available in case someone would not be able to make it and would like to check out the presentation and the discussion that follows.
Thanks, Ildikó
On Sep 3, 2021, at 04:20, Brin Zhang(张百林) <zhangbailin@inspur.com> wrote:
Hi Ildiko,
Currently Cyborg and nova support interaction, we are not very familiar with zun yet, if possible, please provide some relevant information. You can refer to [1] for Cyborg related materials, and [2] for the interactive content of nova and cyborg (not yet merged).
[1]https://docs.openstack.org/cyborg/latest/user/architecture.html [2]https://review.opendev.org/c/openstack/cyborg/+/794549 https://specs.openstack.org/openstack/nova-specs/specs/ussuri/implemented/no...
Bailin Zhang (brinzhang)
-----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年8月31日 22:39 收件人: openstack-discuss <openstack-discuss@lists.openstack.org> 主题: [lists.openstack.org代发][zun][cyborg][kuryr] Re: Edge for scientific research session on September 13 Edge WG meeting
Hi,
It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project.
During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap.
The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented.
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting.
Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Hi Ildiko, We watched your meeting minutes and also discussed within the Cyborg project team (xinranwang, chenke, wenpingsong). I known that zun and Cyborg have been integrated for a while. Is there any problem now? I added this topic to Cyborg PTG's etherpad [1], you can leave a comment on it. [1] https://etherpad.opendev.org/p/cyborg-yoga-ptg brinzhang -----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年9月14日 5:35 收件人: openstack-discuss@lists.openstack.org 抄送: xin-ran.wang@intel.com; Brin Zhang(张百林) <zhangbailin@inspur.com> 主题: Re: [zun][cyborg][kuryr][neutron] Edge for scientific research session on September 13 Edge WG meeting Hi, We had a great session today, thanks to all of you who tuned in. For those of you who couldn’t make it, we have a recording of the presentation and the discussion that followed: https://wiki.openstack.org/wiki/Edge_Computing_Group#CHI.40Edge_-_recording_... Next steps we touched on: * Chameleon integrated Cyborg and Zun ad would like to look into how to upstream that work * Uploading a spec about the integration steps * Discussing the details at the PTG * Chameleon also added a new Neutron ML2 plugin to support Wireguard; it could be a good item to discuss with the Neutron team as well to check upstream potential and make improvements to the agent Please let me know if you have questions to either of the above. Thanks and Best Regards, Ildikó
On Sep 7, 2021, at 17:15, Brin Zhang(张百林) <zhangbailin@inspur.com> wrote:
I will share the recording of the meeting as soon as it is available in case someone would not be able to make it and would like to check out the presentation and the discussion that follows. Thanks for you will share of the record, at 1300UTC I have another meeting (start 1100UTC), if I can end up that meeting earlier, I will join this meeting ^^
brinzhang
-----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年9月8日 6:08 收件人: Brin Zhang(张百林) <zhangbailin@inspur.com> 抄送: openstack-discuss@lists.openstack.org; xin-ran.wang@intel.com 主题: Re: [lists.openstack.org代发][zun][cyborg][kuryr] Edge for scientific research session on September 13 Edge WG meeting
Hi Bailin,
Thank you for sharing the links.
Zun is the project in OpenStack that is supporting to run and manage containers directly from OpenStack without the need of Kubernetes. As the Chameleon project is using it to run their containerized workload and they also need hardware accelerators they integrated it with Cyborg.
Many of their activities fall under the edge computing area and they are starting their collaboration with the OpenInfra Edge Computing group for this reason. As part of that work we are helping them to reach relevant communities and project teams where their requirements identified some gaps and I believe the Cyborg-Zun integration is one of these. They would like to upstream their work if the community finds value in it as it may or may not fall into the current scope of the respective projects.
I hope that we can start to discuss some of this on the meeting next Monday and take next steps from there.
I hope this helps a bit with the context and we can have a fruitful discussion next week.
I will share the recording of the meeting as soon as it is available in case someone would not be able to make it and would like to check out the presentation and the discussion that follows.
Thanks, Ildikó
On Sep 3, 2021, at 04:20, Brin Zhang(张百林) <zhangbailin@inspur.com> wrote:
Hi Ildiko,
Currently Cyborg and nova support interaction, we are not very familiar with zun yet, if possible, please provide some relevant information. You can refer to [1] for Cyborg related materials, and [2] for the interactive content of nova and cyborg (not yet merged).
[1]https://docs.openstack.org/cyborg/latest/user/architecture.html [2]https://review.opendev.org/c/openstack/cyborg/+/794549 https://specs.openstack.org/openstack/nova-specs/specs/ussuri/implemented/no...
Bailin Zhang (brinzhang)
-----邮件原件----- 发件人: Ildiko Vancsa [mailto:ildiko.vancsa@gmail.com] 发送时间: 2021年8月31日 22:39 收件人: openstack-discuss <openstack-discuss@lists.openstack.org> 主题: [lists.openstack.org代发][zun][cyborg][kuryr] Re: Edge for scientific research session on September 13 Edge WG meeting
Hi,
It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project.
During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap.
The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented.
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting.
Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Hi Ildiko, I'm a Cyborg core. I think it's cool to promote the integration of Cyborg and Zun. I'm happy to push the whole thing if I could. Zun's PTL Shengqin Feng is my colleague. I suggest you send her and me a reminder email before the meeting. Her Email: feng.shengqin@zte.com.cn Thanks, Ke Chen At 2021-08-31 22:39:01, "Ildiko Vancsa" <ildiko.vancsa@gmail.com> wrote:
Hi,
It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project.
During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap.
The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented.
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting.
Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Dear Ke Chen, Thank you for the nice feedback and support. I hope the outcome of the discussion and activities that we will start next week will be to upstream this work item so that everyone can benefit from it. I will send you a reminder email about the meeting. See you next Monday! Best Regards, Ildikó
On Sep 4, 2021, at 07:59, 陈克 <joykechen@163.com> wrote:
Hi Ildiko, I'm a Cyborg core. I think it's cool to promote the integration of Cyborg and Zun. I'm happy to push the whole thing if I could. Zun's PTL Shengqin Feng is my colleague. I suggest you send her and me a reminder email before the meeting.
Her Email: feng.shengqin@zte.com.cn
Thanks, Ke Chen
At 2021-08-31 22:39:01, "Ildiko Vancsa" <ildiko.vancsa@gmail.com> wrote:
Hi,
It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project.
During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes. They have also found some gaps during their journey. To mention an example the integration between Cyborg and Zun is missing to be able to use acceleration devices with containers orchestrated by OpenStack and they have been working to fill in this gap.
The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented.
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting.
Thanks and Best Regards, Ildikó
On Aug 25, 2021, at 17:00, Ildiko Vancsa <ildiko.vancsa@gmail.com> wrote:
Hi,
I’m very excited to invite you to a session with the Chameleon project to discuss how edge computing is powering education, scientific research and more! As always in the area of edge there are challenges and gaps that we need to solve together. In that sense the session will start with a presentation that we will then turn into a discussion to turn towards discussing solutions.
Please also note that the Chameleon project is using OpenStack to build edge solutions. As they identified some gaps they would like to work with the community to address the challenges that they’ve been hitting. Please join us to get their feedback and find the best way to improve OpenStack to deliver a platform that can be used on the edge!
The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. For the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings
Please find the details of the session below.
Thanks and Best Regards, Ildikó
Title: Chameleon: a cloud to edge infrastructure for science
Abstract: The NSF-funded Chameleon project (www.chameleoncloud.org) provides an OpenStack-based bare metal reconfigurable cloud that supports systems research, education, and emergent application projects in science. The facility has been in existence for 6+ years, and has served ~6,000 users working on a variety of projects ranging from networking, operating systems design, and security, to innovative applications in astronomy, physics, and life sciences. Recent research trends in IoT and edge computing, as evidenced by increased numbers of project applications in those areas, made it clear that Chameleon needed to expand into the edge space. Remaining within the OpenStack framework allowed us to leverage end-user features that we developed for Chameleon, such as access via federated identity and Jupyter integration. Accordingly, we developed infrastructure called CHI@Edge that adapts Zun to provision containers on edge devices and significantly expands its capabilities to work in the edge space. The talk will describe our use case and the emergent product definition, the OpenStack adaptations we made to the current preview implementation, the directions we plan to take in our further work, as well as the ecosystem of projects and NSF infrastructure deployments leveraging this work and collaborating with us.
Hi, It is a friendly reminder that the OpenInfra Edge Computing Group is having a joint session with the Chameleon project next Monday (September 13). During this session you can learn about the Chameleon project and how they are using OpenStack to build an edge platform for scientific research and academic purposes and the gaps they identified on the way along with the work they started to fill them. The session will start with a presentation about the project and then we will use the remaining time to talk about solutions and next steps. I would like to invite everyone who is interested in learning about how OpenStack can be turned into an edge platform and what are the missing pieces of the puzzle that still need to be enhanced or implemented. The session will take place on the OpenInfra Edge Computing Group weekly call on __September 13, at 1300 UTC / 6am Pacific__. The meeting will be held on Zoom, for the latest dial-in information please refer to this page: https://wiki.openstack.org/wiki/Edge_Computing_Group#Meetings Please let me know if you need a calendar invite and I can send you one to get reminded about the meeting. Thanks and Best Regards, Ildikó
participants (3)
-
Brin Zhang(张百林)
-
Ildiko Vancsa
-
陈克