[GSoC 2018][PROPOSAL] Project Nephos Discussion

claunia commented

2026-01-29 16:42:54 +00:00

Owner

Originally created by @thealphadollar on GitHub (Feb 27, 2018).

Please prefix your issue with one of the following: [BUG], [PROPOSAL], [QUESTION].

CCExtractor version (using the --version parameter preferably) : 0.87

In raising this issue, I confirm the following (please check boxes, eg [X] - and delete unchecked ones):

I have read and understood the contributors guide.
I have checked that the bug-fix I am reporting can be replicated, or that the feature I am suggesting isn't already present.
I have checked that the issue I'm posting isn't already reported.
I have checked that the issue I'm porting isn't already solved and no duplicates exist in closed issues and in opened issues
I have checked the pull requests tab for existing solutions/implementations to my issue/suggestion.
I have used the latest available version of CCExtractor to verify this issue exists.

My familiarity with the project is as follows (check one, eg [X] - and delete unchecked ones):

I have never used CCExtractor.
I have used CCExtractor just a couple of times.
I absolutely love CCExtractor, but have not contributed previously.
I am an active contributor to CCExtractor.

Necessary information

Is this a regression (did it work before)? [ ] NO | [ ] YES - please specify the last known working version
What platform did you use? [ ] Windows - [X] Linux - [ ] Mac
What were the used arguments? -autoprogram

**Video links (replace text below with your links) **

Please make the affected input file available for us (no screenshots, those don't help!). Public links to Dropbox, Google Drive, etc, are all fine. If it is not possible to make it available publicly, send us a private invitation (both Dropbox and Google Drive allow that). In this case we will download the file and upload it to the private developer repository.

Do not upload your file to any location that will require us to sign up or endure a wait list, slow downloads, etc. If your upload expires make sure you keep it active somehow (replace links if needed). Keep in mind that while we go over all tickets some may take a few days, and it's important we have the file available when we actually need it.

Additional information

This issue has been created to keep all the information discussed regarding Nephos documented in a single place for all to see. The project wiki is here, which should be read before asking queries below.

Below are some of the already discussed information:

project Nephos is about storing recordings 24x7 from all around the world, TBs of data everyday.
One idea about monitoring file changes is "do the post-recording tasks via cron every minute rather than have a process running all the time monitoring the directory for changes. It's a trade-off between absolute real time (not a goal, because the post-processing itself takes some minutes, so who cares about a few seconds) and stability... we know that if running from cron even if something bad happens the process will have another chance quickly..."
For now, Different universities can just share the folders in google drive.

Quoting @cfsmp3, the ideas and methods mentioned above can (or rather should) be improved upon :)

PS: Make sure you set an alert in GitHub so you get notifications about your ticket. We may need to ask questions and we do everything inside GitHub's system.

Originally created by @thealphadollar on GitHub (Feb 27, 2018). Please prefix your issue with one of the following: [BUG], [PROPOSAL], [QUESTION]. CCExtractor version (using the --version parameter preferably) : **0.87** **In raising this issue, I confirm the following (please check boxes, eg [X] - and delete unchecked ones):** - [X] I have read and understood the [contributors guide](https://github.com/CCExtractor/ccextractor/blob/master/.github/CONTRIBUTING.md). - [X] I have checked that the bug-fix I am reporting can be replicated, or that the feature I am suggesting isn't already present. - [X] I have checked that the issue I'm posting isn't already reported. - [X] I have checked that the issue I'm porting isn't already solved and no duplicates exist in [closed issues](https://github.com/CCExtractor/ccextractor/issues?q=is%3Aissue+is%3Aclosed) and in [opened issues](https://github.com/CCExtractor/ccextractor/issues) - [X] I have checked the pull requests tab for existing solutions/implementations to my issue/suggestion. - [X] I have used the latest available version of CCExtractor to verify this issue exists. **My familiarity with the project is as follows (check one, eg [X] - and delete unchecked ones):** - [ ] I have never used CCExtractor. - [ ] I have used CCExtractor just a couple of times. - [ ] I absolutely love CCExtractor, but have not contributed previously. - [X] I am an active contributor to CCExtractor. **Necessary information** - Is this a regression (did it work before)? [ ] NO | [ ] YES - *please specify the last known working version* - What platform did you use? [ ] Windows - [X] Linux - [ ] Mac - What were the used arguments? `-autoprogram` **Video links (replace text below with your links) ** Please make the affected input file available for us (no screenshots, those don't help!). Public links to Dropbox, Google Drive, etc, are all fine. If it is not possible to make it available publicly, send us a private invitation (both Dropbox and Google Drive allow that). In this case we will download the file and upload it to the private developer repository. Do *not* upload your file to any location that will require us to sign up or endure a wait list, slow downloads, etc. If your upload expires make sure you keep it active somehow (replace links if needed). Keep in mind that while we go over all tickets some may take a few days, and it's important we have the file available when we actually need it. **Additional information** This issue has been created to keep all the information discussed regarding Nephos documented in a single place for all to see. The project wiki is [here](https://www.ccextractor.org/public:gsoc:projectnephos), which should be read before asking queries below. Below are some of the already discussed information: - project Nephos is about storing recordings 24x7 from all around the world, TBs of data everyday. - One idea about monitoring file changes is "do the post-recording tasks via cron every minute rather than have a process running all the time monitoring the directory for changes. It's a trade-off between absolute real time (not a goal, because the post-processing itself takes some minutes, so who cares about a few seconds) and stability... we know that if running from cron even if something bad happens the process will have another chance quickly..." - For now, Different universities can just share the folders in google drive. Quoting @cfsmp3, the ideas and methods mentioned above can (or rather should) be improved upon :) PS: Make sure you set an alert in GitHub so you get notifications about your ticket. We may need to ask questions and we do everything inside GitHub's system.

claunia added the GSoC-related label 2026-01-29 16:42:54 +00:00

claunia closed this issue

2026-01-29 16:42:54 +00:00

claunia commented

2026-01-29 16:42:55 +00:00

Author

Owner

@thealphadollar commented on GitHub (Mar 5, 2018):

@cfsmp3 I would like to get an idea regarding how the input will be provided to the folder which has to be moved to cloud. This will help me design the method of implementation of content indexing; say Spanish shows are provided in a separate folder, so I can associate a tag with them which will trigger selecting all of them when we require to share all Spanish shows. We can also try (if feasible) get the required information from the meta-data of the stream and accordingly associate samples with appropriate topics.

@thealphadollar commented on GitHub (Mar 5, 2018): @cfsmp3 I would like to get an idea regarding how the input will be provided to the folder which has to be moved to cloud. This will help me design the method of implementation of content indexing; say Spanish shows are provided in a separate folder, so I can associate a tag with them which will trigger selecting all of them when we require to share all Spanish shows. We can also try (if feasible) get the required information from the meta-data of the stream and accordingly associate samples with appropriate topics.

claunia commented

2026-01-29 16:42:55 +00:00

Author

Owner

@thealphadollar commented on GitHub (Mar 6, 2018):

Work until this point:

https://github.com/CCExtractor/ProjectNephos

@thealphadollar commented on GitHub (Mar 6, 2018): Work until this point: https://github.com/CCExtractor/ProjectNephos

claunia commented

2026-01-29 16:42:55 +00:00

Author

Owner

@thealphadollar commented on GitHub (Mar 14, 2018):

For the recording part, we can use tvstreamrecord as inspiration and also freely use parts of their code (giving adequate credits to the developer).

We've got explicit permission from the developer of the project.

@thealphadollar commented on GitHub (Mar 14, 2018): For the recording part, we can use [tvstreamrecord](http://pavion.github.io/tvstreamrecord/) as inspiration and also freely use parts of their code (giving adequate credits to the developer). We've got explicit permission from the developer of the project.

claunia commented

2026-01-29 16:42:56 +00:00

Author

Owner

@thealphadollar commented on GitHub (Apr 6, 2018):

Closed since GSoC submission period is over.

@thealphadollar commented on GitHub (Apr 6, 2018): Closed since GSoC submission period is over.

[GSoC 2018][PROPOSAL] Project Nephos Discussion #395