<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JCC</journal-id><journal-title-group><journal-title>Journal of Computer and Communications</journal-title></journal-title-group><issn pub-type="epub">2327-5219</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jcc.2018.611012</article-id><article-id pub-id-type="publisher-id">JCC-88549</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Computer Science&amp;Communications</subject></subj-group></article-categories><title-group><article-title>
 
 
  Main Processes for OVS-1A &amp; OVS-1B: From Manufacturer to User
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Shixiang</surname><given-names>Cao</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Wenwen</surname><given-names>Qi</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Wei</surname><given-names>Tan</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Nan</surname><given-names>Zhou</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Yongfu</surname><given-names>Hu</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff1"><addr-line>Satellite Technique Support Team, Beijing Institute of Space Mechanics &amp;amp; Electricity, Beijing, China</addr-line></aff><pub-date pub-type="epub"><day>07</day><month>11</month><year>2018</year></pub-date><volume>06</volume><issue>11</issue><fpage>126</fpage><lpage>137</lpage><history><date date-type="received"><day>16,</day>	<month>October</month>	<year>2018</year></date><date date-type="rev-recd"><day>12,</day>	<month>November</month>	<year>2018</year>	</date><date date-type="accepted"><day>19,</day>	<month>November</month>	<year>2018</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  
    Commercial remote sensing has boosted a new revolution in traditional processing chain. During the development of OVS-1A and OVS-1B, we construct the main processing pipeline for ground and calibration system. Since these two satellites utilize colorful video imaging pattern, the underlying video stabilization and color adjustment is vital for end user. Besides that, a full explanation is given for researchers to shed light on how to promote the imagery quality from manufacturing satellite camera to generate video products. From processing system, the demo cases demonstrate its potential to satisfy end user. Our team also releases the possible improvement for video imaging satellite in the coming future. 
  
 
</p></abstract><kwd-group><kwd>Remote Sensing</kwd><kwd> Video Satellite</kwd><kwd> Image Processing</kwd><kwd> Manufacture  Improvement</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The OVS-1A and OVS-1B video satellites (also known as ZHUHAI-1 01 and ZHUHAI-1 02 [<xref ref-type="bibr" rid="scirp.88549-ref1">1</xref>]) were launched on June 15, 2017, and the two equipped cameras can capture 10-bit image or 8-bit video sequence at 20 fps both converting from Bayer formatted data.</p><p>After one year running around, we feel honorable to reveal the main processing methods used, which may be different from general close range community, for end user.</p><p>In the past few years, mini satellite for commercial user is largely developed from overhead video imaging which can be recently dated back to typical SkySat [<xref ref-type="bibr" rid="scirp.88549-ref2">2</xref>]. Nowadays, the surveillance need for local interesting event is boosted in many industrial or military applications, such as interesting region surveillance, coastline defense [<xref ref-type="bibr" rid="scirp.88549-ref3">3</xref>].</p><p>Given a tight budget, Beijing Institute of Space Mechanics &amp; Electricity (shown as BISME hereinafter) undertook the contract in 2016 from Zhuhai Orbita Aerospace Science &amp; Technology Co, Ltd. (available at http://www.myorbita.net/), which must be finished in one year. Our engineers inherit some effective design from industrial applications and furthermore proposed some techniques to promote higher quality for standard product.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref> and <xref ref-type="table" rid="table1">Table 1</xref> show the appearance and system characteristics of these two satellite cameras. Opposite to the combined imaging plane of SkySat, the platform chooses to rotate to hold the nadir viewport all the time, and a common 90 seconds duration video sequences are stored on board or directly transferred to ground station.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Camera system charactersitic</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Name</th><th align="center" valign="middle" >Value</th></tr></thead><tr><td align="center" valign="middle" >Area detector pixels</td><td align="center" valign="middle" >4096 &#215; 3072</td></tr><tr><td align="center" valign="middle" >GSD</td><td align="center" valign="middle" >OVS-1A: 1.98 m OVS-1B: 1.96 m</td></tr><tr><td align="center" valign="middle" >Frame rate</td><td align="center" valign="middle" >20 fps working at video mode; 1 fps working at footprint mode</td></tr><tr><td align="center" valign="middle" >Quantilization Level</td><td align="center" valign="middle" >8 bit working at video mode; 10 bit working at footprint mode</td></tr><tr><td align="center" valign="middle" >Focal length</td><td align="center" valign="middle" >OVS-1A: 1536.2 mm OVS-1B: 1540.3 mm</td></tr><tr><td align="center" valign="middle" >Spectral range</td><td align="center" valign="middle" >OVS-1A: 410 - 706 nm OVS-1B: 418 - 704 nm</td></tr><tr><td align="center" valign="middle" >Weight</td><td align="center" valign="middle" >12.93 kg</td></tr><tr><td align="center" valign="middle" >Size</td><td align="center" valign="middle" >OVS-1A: 256.20 mm &#215; 294.26 mm &#215; 506.10 mm OVS-1B: 256.10 mm &#215; 295.36 mm &#215; 507.40 mm</td></tr></tbody></table></table-wrap><p>From the working mode in <xref ref-type="fig" rid="fig1">Figure 1</xref>, one thing should be noted the viewing angle always varies, and bad effect also comes from the platform vibration at 550 km, even its absolute value is small, this is why we carefully designed the stabilization method.</p><p>To the radiometric calibration, a classical and uniform region is not practical any more [<xref ref-type="bibr" rid="scirp.88549-ref4">4</xref>], and statistical analysis for line sensor fails the area plane detector, and the real value of each pixel should be computed individually.</p><p>A subset of real image covering Cape Town is given in <xref ref-type="fig" rid="fig2">Figure 2</xref>. As a first impression, we list all the techniques embedded in this paper:</p><p>1) How to get high level radiometric calibration result for area device;</p><p>2) How to make change for Bayer formatted pixel to get an uniform image;</p><p>3) How to calculate the color transformation for true RGB;</p><p>4) How to implement video stabilization and approximately still video;</p><p>5) Geometrical processes for video sequences.</p></sec><sec id="s2"><title>2. Radiometric Model</title><p>Before going to the main process, the linear model should be given for imaging pixel, and the reader can go to this section after knowing the challenge for future devices. The widely used is linear model [<xref ref-type="bibr" rid="scirp.88549-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.88549-ref6">6</xref>]: the DN value can be calibrated as a linear relationship with radiance.</p><p>Suppose the area scanner contains m &#215; n pixels, 4096 &#215; 3072 in this paper, digital number of any pixel in image B can be expressed as:</p><p>B i , j = K i , j ⋅ L e + C i , j , i = 1 , 2 , ⋯ , m , j = 1 , 2 , ⋯ , n (1)</p><p>L e = ∫ λ 1 λ 2 r ( λ ) R ( λ ) d λ ∫ λ 1 λ 2 R ( λ ) d λ (2)</p><p>where B ( i , j ) ―the DN value in image B;</p><p>L e ―equivalent radiance from calibration light;</p><p>K i , j ―gain for radiance;</p><p>C i , j ―offset for radiance;</p><p>R ( λ ) ―relative spectral response;</p><p>r ( λ ) ―transmittance of optical system;</p><p>λ 1 and λ 2 ―range of wave length.</p><p>In most cases, the non-uniform noise in image mainly comes from the gain and offset differences of every pixel.</p></sec><sec id="s3"><title>3. Main Processing</title><p>From the calibration images, the normal no-uniformity coefficient can be calculated. Then stack the surface image at high and low digital value to generate two virtual images, a linear fitness of these two images modifies the initial NU coefficients. After that, we utilize the radiometric parameter to enhance image, generate L1 to L2 and video product. <xref ref-type="fig" rid="fig3">Figure 3</xref> shows the main pipeline of following steps.</p><sec id="s3_1"><title>3.1. No-Uniformity Correction</title><p>Using the initial calibration data, the top of atmospheric no-uniformity coefficient for raw data can be drawn as:</p><p>D N L = K i , j ⋅ B L ( i , j ) &#175; + C i , j (3)</p><p>D N H = K i , j ⋅ B H ( i , j ) &#175; + C i , j (4)</p><p>B L ( i , j ) &#175; = 1 m ⋅ n ∑ i = 1 m ∑ j = 1 n B L ( i , j ) (5)</p><p>B H ( i , j ) &#175; = 1 m ⋅ n ∑ i = 1 m ∑ j = 1 n B H ( i , j ) (6)</p><p>Above processes fit response of every pixel to the statistical mean value, and generate the initial gain and offset coefficients K i , j and C i , j . <xref ref-type="fig" rid="fig4">Figure 4</xref> shows the correction result in lab.</p><p>Specially, for Bayer image, there should be two normal approaches for RGB channels calibration separately:</p><p>1) interpolate Bayer to virtual RGB, calibrate RGB separately;</p><p>2) pick real RGB from Bayer, calibrate them and demosaic to get final result.</p><p>We found the latter one is a physical and strict data reconstruction method which generates better result. In one word, Bayer image cannot be interpolated to RGB before radiometric calibration. <xref ref-type="fig" rid="fig5">Figure 5</xref> illustrates the specific operation.</p><p>After the launch, non-uniform noise still residues in real image, and it can be easily attributed to atmosphere or some other transfer jitter. Actually, with the help of our former work [<xref ref-type="bibr" rid="scirp.88549-ref7">7</xref>], we stacked the high DN image from mid latitude cloud and low level image covering nightly ocean, and got near 3% radiometric result after a second calibration. <xref ref-type="fig" rid="fig6">Figure 6</xref> outlines the strengthened result from our method.</p></sec><sec id="s3_2"><title>3.2. Color Adjustment and Image Dehaze</title><p>Excellent results can usually be achieved with the inexpensive, widely-available 24-patch X-Rite color checker. The CCM (color correction matrix) can be applied to images to achieve optimum color reproduction, which is defined as the minimum mean squared color error between a corrected test chart patches and the corresponding reference values, which can be the standard (published) values.</p><p>From the radiometric model, the R, G, and B values of each output (corrected) pixel is mathematically a linear combination of the three input color channels, Equation (7) shows the recommended 3 &#215; 3 CCM A and its usage, where the P is processed pixel and O is the original color value:</p><p>[ P R 1 P G 1 P B 1 P R 2 P G 2 P B 2 ⋯ P R k P G k P B k ] = [ O R 1 O G 1 O B 1 O R 2 O G 2 O B 2 ⋯ O R k O G k O B k ] [ A 11 A 12 A 13 A 21 A 22 A 23 A 31 A 32 A 33 ] (7)</p><p>And also, 4 &#215; 3 CCM usually works fine, please refer to [<xref ref-type="bibr" rid="scirp.88549-ref8">8</xref>] for more details. <xref ref-type="fig" rid="fig7">Figure 7</xref> is the picture of X-Rite color checker from OVS-1A and its correction result.</p><p>Consider the launching time is near winter in China, the atmosphere is somewhat cloudy especially near the North China, we introduce the dark channel prior to remove the bad effect and maintain a comfortable visualization. <xref ref-type="fig" rid="fig8">Figure 8</xref> lists the demo case for Zhengzhou airport.</p></sec><sec id="s3_3"><title>3.3. Video Stabilization and Registration</title><p>Due to the mechanical vibrations caused by the engine and the effect of turbulent</p><p>wind, the video is distorted and unstable. Therefore the video frames have to be stabilized for immediate object detection and real time surveillance. Video stabilization is a process to reduce the unwanted motion of the camera so as to remove the jitter and instability in the video frames [<xref ref-type="bibr" rid="scirp.88549-ref9">9</xref>].</p><p>Mechanical stabilization employs mechanical devices like gimbal to reduce the vibration of the structure holding the camera. However, this method is not able to reduce all the vibrations and is costly to implement. The Digital stabilization technique, however employs image processing based methods and can be used to remove the needless vibration that cannot be removed by Mechanical stabilization method. It costs less than the Mechanical technique as it does not involve complex hardware and requires only software to stabilize the video. Therefore digital stabilization is a better method of stabilization since it is inexpensive and easy to implement.</p><p>We noticed a parametric strategy in IPOL (www.ipol.im) with open source implementation [<xref ref-type="bibr" rid="scirp.88549-ref10">10</xref>], and used feature-based motion (homography) estimation with local matrix-based motion smoothing, and <xref ref-type="fig" rid="fig9">Figure 9</xref> shows the basic framework.</p><p>For further approximately still video, we choose a registration method based on feature point to generate such product. SIFT [<xref ref-type="bibr" rid="scirp.88549-ref11">11</xref>] or ASIFT [<xref ref-type="bibr" rid="scirp.88549-ref12">12</xref>] feature descriptor can be used directly after receiving the stabilized sequences. <xref ref-type="fig" rid="fig1">Figure 1</xref>0 shows the processed result for Marseille.</p></sec><sec id="s3_4"><title>3.4. Video Compression</title><p>Although the compression standard is common in close range community, we got response from end user the compression always damage the expert analysis for small object, especially the high profile H.264 standard (it will incur small blocks near the edge and is of various compression ratios).</p><p>Hence, we limited the compression ration no more than 10 for interested region (or quality test video) and no more than 30 in other regions.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> SNR value using different object</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  >Condition</th><th align="center" valign="middle"  colspan="2"  >SNR</th></tr></thead><tr><td align="center" valign="middle" >OVS-1A</td><td align="center" valign="middle" >OVS-1B</td></tr><tr><td align="center" valign="middle" >Solarzenith 70 degree and 0.7 reflective land</td><td align="center" valign="middle" >39.925 db</td><td align="center" valign="middle" >39.625 db</td></tr><tr><td align="center" valign="middle" >Solarzenith 30 degree and 0.2 reflective land</td><td align="center" valign="middle" >31.5 db</td><td align="center" valign="middle" >31.575 db</td></tr><tr><td align="center" valign="middle" >Solarzenith 20 degree and 0.05 reflective land</td><td align="center" valign="middle" >26.275 db</td><td align="center" valign="middle" >26.15 db</td></tr></tbody></table></table-wrap></sec><sec id="s3_5"><title>3.5. Geometric Processing</title><p>After building RPC file using attitude and GPS data, we can construct the L2 product mapped into a cartographic projection and corrected from sensor and terrain distortions. The mean value of geometrical location error is 500m after system correction and calibration (small satellite without high level star sensor).</p><p>Mosaic products will be automatically processed in order to provide end user with an ortho-image of larger size, this is vital for multi footprint mode.</p></sec></sec><sec id="s4"><title>4. Image Quality Evaluation</title><sec id="s4_1"><title>4.1. Module Transfer Function Value and SNR</title><p>We do not pave the traditional knife edge pattern (high cost) but find some natural object such as road or building to test the MTF value, showing in <xref ref-type="fig" rid="fig1">Figure 1</xref>1.</p><p><xref ref-type="table" rid="table2">Table 2</xref> simply outlines the SNR result testified in different condition. Obvious difference can be seen the SNR value is not high while 45 db is common for TDI (Time delay integration) sensor, and explanation is the frame exposure time will not be long to balance DN value and fast moving object detection.</p></sec><sec id="s4_2"><title>4.2. Video Stabilization Level</title><p>To quantify our video stabilization method, we carefully detect the matched feature points and calculate the residual error of every frame. In Figure12, it can be seen the average of error distance is reduced from largest 5 pixels to no more than 1 pixel in every frame after our processing, which prove its effectiveness (please go to <xref ref-type="table" rid="table3">Table 3</xref>).</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Video stabilization error of different methods</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Method</th><th align="center" valign="middle" >Distance of matching points</th></tr></thead><tr><td align="center" valign="middle" >SIFT</td><td align="center" valign="middle" >2.65 pixels</td></tr><tr><td align="center" valign="middle" >Parametric strategy</td><td align="center" valign="middle" >1.93 pixels</td></tr><tr><td align="center" valign="middle" >Our method</td><td align="center" valign="middle" >0.86 pixels</td></tr></tbody></table></table-wrap><p>One thing should be kept in mind, this approach will not be used in video sequences with rare feature point, such as small ocean island, desert region.</p></sec></sec><sec id="s5"><title>5. Conclusions</title><p>OVS system is designed hoping to optimize the end user’s need. Its main image quality performances are ensured by appropriate processing line in end user’s production center (we worked on it for months).</p><p>Despite the success or progress, we noticed:</p><p>1) There are potential drawbacks to using color filter array (CFA) sensor such as Bayer filter, since CFA inherently lowers the resolution of the underlying staring sensor relative to a single spectrum image [<xref ref-type="bibr" rid="scirp.88549-ref2">2</xref>]. We are now designing more practical and effective system for overhead video system;</p><p>2) Video mode remote sensing lacks universal framework to guide how to construct the product, and end user usually cannot get the longitude or latitude from video product from any video player. We anticipate a full analysis to get an engineering product definition in the coming soon future.</p><p>After OVS-1A and OVS-1B, we successfully designed the TDI mode for area detector and extend the data picturing mode to traditional long strip.</p><p>Last but not least, Orbita has launched its newest video satellite with 0.9m resolution in 2018 July, and it can also be seen as another symbol for developing consumer remote sensing.</p></sec><sec id="s6"><title>Acknowledgements</title><p>Thanks should be given to Senior Engineer Pan in Orbita for opening the data center to us.</p><p>This research has been partly supported by National Natural Science Foundation of China under Grant 61701023.</p></sec><sec id="s7"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s8"><title>Cite this paper</title><p>Cao, S.X., Qi, W.W., Tan, W., Zhou, N. and Hu, Y.F. (2018) Main Processes for OVS-1A &amp; OVS- 1B: From Manufacturer to User. Journal of Computer and Communications, 6, 126-137. https://doi.org/10.4236/jcc.2018.611012</p></sec></body><back><ref-list><title>References</title><ref id="scirp.88549-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">N2YO.com (October) ZHUHAI-1 02 (CAS 4B), Track ZHUHAI-1 02 (CAS 4B) Now! http://www.n2yo.com/satellite/?s=42759</mixed-citation></ref><ref id="scirp.88549-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Mann, J.M., Berkenstock, D. and Robinson, M.D. (2013) Systems and Methods for Overhead Imaging and Video. US Patent: No. 8487996B2.</mixed-citation></ref><ref id="scirp.88549-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Schowengerdt, R.A. (2013) Remote Sensing: Models and Methods for Image Processing. 3rd Edition, Academic Press, London.</mixed-citation></ref><ref id="scirp.88549-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Yin, S.M., Hong, X.H., Liu, S.Q. and Fu, X.N. (2004) New Algorithm of Adaptive Nonuniformity Correction for IRFPA. Journal of Infrared and Millimeter Waves, 23, 33-37. https://doi.org/10.3321/j.issn:1001-9014.2004.01.007</mixed-citation></ref><ref id="scirp.88549-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Zhao, X.Y., Zhang, W. and Xie, X.F. (2010) Study of Relationship between Absolute Calibration and Relative Calibration. Infrared, 31, 23-30.  
https://doi.org/10.3969/j.issn.1672-8785.2010.09.006</mixed-citation></ref><ref id="scirp.88549-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Friedenberg, A. and Goldblatt, I. (1998) Nonuniformity Two-Point Linear Correction Errors in Infrared Focal Plane Arrays. Optical Engineering, 37, 1251-1253.  
https://doi.org/10.1117/1.601890</mixed-citation></ref><ref id="scirp.88549-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Cao, S.X., Li, Y., Jiang, C. and Jia, G.R. (2017) Statistical Non-Uniformity Correction for Paddlebroom Thermal Infrared Image. Second International Conference on Multimedia and Image Processing, Wuhan, 17-19 March 2017, 1-5.</mixed-citation></ref><ref id="scirp.88549-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Wolf, S. (2003) Color Correction Matrix for Digital Still and Video Imaging Systems. National Telecommunications and Information Administration.</mixed-citation></ref><ref id="scirp.88549-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Kejriwal, L. and Singh, I. (2016) A Hybrid filtering approach of Digital Video Stabilization for UAV Using Kalman and Low Pass Filter. International Conference on Advances in Computing &amp; Communications, 93, 359-366.</mixed-citation></ref><ref id="scirp.88549-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Sanchez, J. (2017) Comparison of Motion Smoothing Strategies for Video Stabilization Using Parametric Models. Image Processing Online, 1, 309-346.  
https://doi.org/10.5201/ipol.2017.209</mixed-citation></ref><ref id="scirp.88549-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Low, D. (2004) Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60, 99-110.  
https://doi.org/10.1023/B:VISI.0000029664.99615.94</mixed-citation></ref><ref id="scirp.88549-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Morel, J.-M. and Yu G.S. (2009) ASIFT: A New Framework for Fully Affine Invariant Image Comparison. SIAM Journal on Imaging Sciences, 2, 438-469.  
https://doi.org/10.1137/080732730</mixed-citation></ref></ref-list></back></article>