title: On the Period-Ratio-Mass-Ratio Correlation of Extra-Solar Multi-Planet Systems

abstract: In order to gain possible hints for planet formation from the current data of known extra-solar planets, the period-ratios and mass-ratios of adjacent planet pairs in multi-planet systems are determined. A moderate period-ratio-mass-ratio correlation is found to have a correlation coefficient r=0.5779 with 99% confidence interval (0.464, 0.672). In contrast, for non-adjacent planet pairs, the correlation coefficient is r=0.2820 with 99% confidence interval (0.133, 0.419). Our results reveal the imprint of planet-planet interactions of the adjacent planet pairs in a certain fraction of the multi-planet systems during the stage of planet formation.


title: Volumetric Propagation Network: Stereo-LiDAR Fusion for Long-Range Depth Estimation

abstract: Stereo-LiDAR fusion is a promising task in that we can utilize two different types of 3D perceptions for practical usage -- dense 3D information (stereo cameras) and highly-accurate sparse point clouds (LiDAR). However, due to their different modalities and structures, the method of aligning sensor data is the key for successful sensor fusion. To this end, we propose a geometry-aware stereo-LiDAR fusion network for long-range depth estimation, called volumetric propagation network. The key idea of our network is to exploit sparse and accurate point clouds as a cue for guiding correspondences of stereo images in a unified 3D volume space. Unlike existing fusion strategies, we directly embed point clouds into the volume, which enables us to propagate valid information into nearby voxels in the volume, and to reduce the uncertainty of correspondences. Thus, it allows us to fuse two different input modalities seamlessly and regress a long-range depth map. Our fusion is further enhanced by a newly proposed feature extraction layer for point clouds guided by images: FusionConv. FusionConv extracts point cloud features that consider both semantic (2D image domain) and geometric (3D domain) relations and aid fusion at the volume. Our network achieves state-of-the-art performance on the KITTI and the Virtual-KITTI datasets among recent stereo-LiDAR fusion methods.


title: A Multi-wavelength Study on the Formation of AFGL 333-Ridge

abstract: We presented a multi-wavelength study of AFGL 333-Ridge. The molecular line data reveals that the AFGL 333-Ridge has two independent velocity components at -50.5 km/s and -48.0 km/s. In the Position-Velocity diagram, the bridge feature connects with two parts that are spatially correlated but separated in velocity. These observational evidences support the scenario that the two velocity components have collided and merged into one molecular cloud. The majority of Class I YSOs are distributed within the collision region, suggesting that the cloud-cloud collision has induced the YSOs formation in the ridge. Using the radio recombination line (RRL) data obtained by the Five-hundred-meter Aperture Spherical radio Telescope (FAST), the RRL velocities of three HII regions are consistent with that of the AFGL 333-Ridge. By comparing the three HII regions' dynamical ages with the collision timescale of the two components, we conclude that the influence of the three HII regions may not drive the two clouds to merge. The formation of the AFGL 333-Ridge is probably due to the expansion of the giant HII region W4.


title: Hierarchical deep reinforcement learning controlled three-dimensional navigation of microrobots in blood vessels

abstract: Designing intelligent microrobots that can autonomously navigate and perform instructed routines in blood vessels, a complex and crowded environment with obstacles including dense cells, different flow patterns and diverse vascular geometries, can offer enormous possibilities in biomedical applications. Here we report a hierarchical control scheme that enables a microrobot to efficiently navigate and execute customizable routines in blood vessels. The control scheme consists of two highly decoupled components: a high-level controller setting short-ranged dynamic targets to guide the microrobot to follow a preset path and a low-level deep reinforcement learning (DRL) controller responsible for maneuvering microrobots towards these dynamic guiding targets. The proposed DRL controller utilizes three-dimensional (3D) convolutional neural networks and is capable of learning control policy directly from a coarse raw 3D sensory input. In blood vessels with rich configurations of red blood cells and vessel geometry, the control scheme enables efficient navigation and faithful execution of instructed routines. The control scheme is also robust to adversarial perturbations including blood flows. This study provides a proof-of-principle for designing data-driven control systems for autonomous navigation in vascular networks; it illustrates the great potential of artificial intelligence for broad biomedical applications such as target drug delivery, blood clots clear, precision surgery, disease diagnosis, and more.


title: Heavy-tailed distribution for combining dependent $p$-values with asymptotic robustness

abstract: The issue of combining individual $p$-values to aggregate multiple small effects is prevalent in many scientific investigations and is a long-standing statistical topic. Many classical methods are designed for combining independent and frequent signals in a traditional meta-analysis sense using the sum of transformed $p$-values with the transformation of light-tailed distributions, in which Fisher's method and Stouffer's method are the most well-known. Since the early 2000, advances in big data promoted methods to aggregate independent, sparse and weak signals, such as the renowned higher criticism and Berk-Jones tests. Recently, Liu and Xie(2020) and Wilson(2019) independently proposed Cauchy and harmonic mean combination tests to robustly combine $p$-values under "arbitrary" dependency structure, where a notable application is to combine $p$-values from a set of often correlated SNPs in genome-wide association studies. The proposed tests are the transformation of heavy-tailed distributions for improved power with the sparse signal. It calls for a natural question to investigate heavy-tailed distribution transformation, to understand the connection among existing methods, and to explore the conditions for a method to possess robustness to dependency. In this paper, we investigate the regularly varying distribution, which is a rich family of heavy-tailed distribution and includes Pareto distribution as a special case. We show that only an equivalent class of Cauchy and harmonic mean tests have sufficient robustness to dependency in a practical sense. We also show an issue caused by large negative penalty in the Cauchy method and propose a simple, yet practical modification. Finally, we present simulations and apply to a neuroticism GWAS application to verify the discovered theoretical insights and provide practical guidance.


title: Receding Horizon Motion Planning for Multi-Agent Systems: A Velocity Obstacle Based Probabilistic Method

abstract: In this paper, a novel and innovative methodology for feasible motion planning in the multi-agent system is developed. On the basis of velocity obstacles characteristics, the chance constraints are formulated in the receding horizon control (RHC) problem, and geometric information of collision cones is used to generate the feasible regions of velocities for the host agent. By this approach, the motion planning is conducted at the velocity level instead of the position level. Thus, it guarantees a safer collision-free trajectory for the multi-agent system, especially for the systems with high-speed moving agents. Moreover, a probability threshold of potential collisions can be satisfied during the motion planning process. In order to validate the effectiveness of the methodology, different scenarios for multiple agents are investigated, and the simulation results clearly show that the proposed approach can effectively avoid potential collisions with a collision probability less than a specific threshold.


title: A VAE-Bayesian Deep Learning Scheme for Solar Generation Forecasting based on Dimensionality Reduction

abstract: The advancement of distributed generation technologies in modern power systems has led to a widespread integration of renewable power generation at customer side. However, the intermittent nature of renewable energy poses new challenges to the network operational planning with underlying uncertainties. This paper proposes a novel Bayesian probabilistic technique for forecasting renewable solar generation by addressing data and model uncertainties by integrating bidirectional long short-term memory (BiLSTM) neural networks while compressing the weight parameters using variational autoencoder (VAE). Existing Bayesian deep learning methods suffer from high computational complexities as they require to draw a large number of samples from weight parameters expressed in the form of probability distributions. The proposed method can deal with uncertainty present in model and data in a more computationally efficient manner by reducing the dimensionality of model parameters. The proposed method is evaluated using quantile loss, reconstruction error, and deterministic forecasting evaluation metrics such as root-mean square error. It is inferred from the numerical results that VAE-Bayesian BiLSTM outperforms other probabilistic and deterministic deep learning methods for solar power forecasting in terms of accuracy and computational efficiency for different sizes of the dataset.


title: Outage Probability Expressions for an IRS-Assisted System with and without Source-Destination Link for the Case of Quantized Phase Shifts in $\kappa-\mu$ fading

abstract: In this work, we study the outage probability (OP) at the destination of an intelligent reflecting surface (IRS) assisted communication system in a $\kappa-\mu$ fading environment. A practical system model that takes into account the presence of phase error due to quantization at the IRS when a) source-destination (SD) link is present and b) SD link is absent is considered. First, an exact expression is derived, and then we derive three simple approximations for the OP using the following approaches: (i) uni-variate dimension reduction, (ii) moment matching and, (iii) Kullback-Leibler divergence minimization. The resulting expressions for OP are simple to evaluate and quite tight even in the tail region. The validity of these approximations is demonstrated using extensive Monte Carlo simulations. We also study the impact of the number of bits available for quantization, the position of IRS with respect to the source and destination and the number of IRS elements on the OP for systems with and without an SD link.


title: Grover/Zeta Correspondence based on the Konno-Sato theorem

abstract: Recently the Ihara zeta function for the finite graph was extended to infinite one by Clair and Chinta et al. In this paper, we obtain the same expressions by a different approach from their analytical method. Our new approach is to take a suitable limit of a sequence of finite graphs via the Konno-Sato theorem. This theorem is related to explicit formulas of characteristic polynomials for the evolution matrix of the Grover walk. The walk is one of the most well-investigated quantum walks which are quantum counterpart of classical random walks. We call the relation between the Grover walk and the zeta function based on the Konno-Sato theorem "Grover/Zeta Correspondence" here.


title: Hetero-Modal Learning and Expansive Consistency Constraints for Semi-Supervised Detection from Multi-Sequence Data

abstract: Lesion detection serves a critical role in early diagnosis and has been well explored in recent years due to methodological advancesand increased data availability. However, the high costs of annotations hinder the collection of large and completely labeled datasets, motivating semi-supervised detection approaches. In this paper, we introduce mean teacher hetero-modal detection (MTHD), which addresses two important gaps in current semi-supervised detection. First, it is not obvious how to enforce unlabeled consistency constraints across the very different outputs of various detectors, which has resulted in various compromises being used in the state of the art. Using an anchor-free framework, MTHD formulates a mean teacher approach without such compromises, enforcing consistency on the soft-output of object centers and size. Second, multi-sequence data is often critical, e.g., for abdominal lesion detection, but unlabeled data is often missing sequences. To deal with this, MTHD incorporates hetero-modal learning in its framework. Unlike prior art, MTHD is able to incorporate an expansive set of consistency constraints that include geometric transforms and random sequence combinations. We train and evaluate MTHD on liver lesion detection using the largest MR lesion dataset to date (1099 patients with >5000 volumes). MTHD surpasses the best fully-supervised and semi-supervised competitors by 10.1% and 3.5%, respectively, in average sensitivity.


title: Manipulating Berry curvature of SrRuO3 thin films via epitaxial strain

abstract: Berry curvature plays a crucial role in exotic electronic states of quantum materials, such as intrinsic anomalous Hall effect. As Berry curvature is highly sensitive to subtle changes of electronic band structures, it can be finely tuned via external stimulus. Here, we demonstrate in SrRuO3 thin films that both the magnitude and sign of anomalous Hall resistivity can be effectively controlled with epitaxial strain. Our first-principles calculations reveal that epitaxial strain induces an additional crystal field splitting and changes the order of Ru d orbital energies, which alters the Berry curvature and leads to the sign and magnitude change of anomalous Hall conductivity. Furthermore, we show that the rotation of Ru magnetic moment in real space of tensile strained sample can result in an exotic nonmonotonic change of anomalous Hall resistivity with the sweeping of magnetic field, resembling the topological Hall effect observed in non-coplanar spin systems. These findings not only deepen our understanding of anomalous Hall effect in SrRuO3 systems, but also provide an effective tuning knob to manipulate Berry curvature and related physical properties in a wide range of quantum materials.


title: Proximity Effect of Epitaxial Iron Phthalocyanine Molecules on High-Quality Graphene Devices

abstract: Depositing magnetic insulators on graphene has been a promising route to introduce magnetism via exchange proximity interaction in graphene for future spintronics applications. Molecule-based magnets may offer unique opportunities because of their synthesis versatility. Here, we investigated the magnetic proximity effect of epitaxial iron phthalocyanine (FePc) molecules on high-quality monolayer and bilayer graphene devices on hexagonal boron nitride substrate by probing the local and non-local transport. Although the FePc molecules introduce large hole doping effects combined with mobility degradation, the magnetic proximity gives rise to a canted antiferromagnetic state under a magnetic field in the monolayer graphene. On bilayer graphene and FePc heterostructure devices, the non-local transport reveals a pronounced Zeeman spin-Hall effect. Further analysis of the scattering mechanism in the bilayer shows a dominated long-range scattering. Our findings in graphene/organic magnetic insulator heterostructure provide a new insight for the use of molecule-based magnets in two-dimensional spintronic devices.


title: VLGrammar: Grounded Grammar Induction of Vision and Language

abstract: Cognitive grammar suggests that the acquisition of language grammar is grounded within visual structures. While grammar is an essential representation of natural language, it also exists ubiquitously in vision to represent the hierarchical part-whole structure. In this work, we study grounded grammar induction of vision and language in a joint learning framework. Specifically, we present VLGrammar, a method that uses compound probabilistic context-free grammars (compound PCFGs) to induce the language grammar and the image grammar simultaneously. We propose a novel contrastive learning framework to guide the joint learning of both modules. To provide a benchmark for the grounded grammar induction task, we collect a large-scale dataset, \textsc{PartIt}, which contains human-written sentences that describe part-level semantics for 3D objects. Experiments on the \textsc{PartIt} dataset show that VLGrammar outperforms all baselines in image grammar induction and language grammar induction. The learned VLGrammar naturally benefits related downstream tasks. Specifically, it improves the image unsupervised clustering accuracy by 30\%, and performs well in image retrieval and text retrieval. Notably, the induced grammar shows superior generalizability by easily generalizing to unseen categories.


title: Deep exploration for continuous gravitational waves at 171--172 Hz in LIGO second observing run data

abstract: We pursue a novel strategy towards a first detection of continuous gravitational waves from rapidly-rotating deformed neutron stars. Computational power is focused on a narrow region of signal parameter space selected by a strategically-chosen benchmark. We search data from the 2nd observing run of the LIGO Observatory with an optimised analysis run on graphics processing units. While no continuous waves are detected, the search achieves a sensitivity to gravitational wave strain of $h_0 = 1.01{\times}10^{-25}$ at 90% confidence, 24% to 69% better than past searches of the same parameter space. Constraints on neutron star deformity are within theoretical maxima, thus a detection by this search was not inconceivable.


title: Chiral dynamics and S-wave contributions in $\bar B^0/D^0 \to \pi^{\pm}\eta\ l^{\mp} \nu$ decays

abstract: In this work, we analyze the semi-leptonic decays $\bar B^0/D^0 \to (a_0(980)^{\pm}\to\pi^{\pm}\eta) l^{\mp} \nu$ within light-cone sum rules. The two and three-body light-cone distribution amplitudes (LCDAs) of the $B$ meson and the only available two-body LCDA of the $D$ meson are used. To include the finite-width effect of the $a_0(980)$, we use a scalar form factor to describe the final-state interaction between the $\pi\eta$ mesons, which was previously calculated within unitarized Chiral Perturbation Theory. The result for the decay branching fraction of the $D^0$ decay is in good agreement with that measured by the BESIII Collaboration, while the branching fraction of the $\bar B^0$ decay can be tested in future experiments.


title: RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentation

abstract: Point clouds can be represented in many forms (views), typically, point-based sets, voxel-based cells or range-based images(i.e., panoramic view). The point-based view is geometrically accurate, but it is disordered, which makes it difficult to find local neighbors efficiently. The voxel-based view is regular, but sparse, and computation grows cubically when voxel resolution increases. The range-based view is regular and generally dense, however spherical projection makes physical dimensions distorted. Both voxel- and range-based views suffer from quantization loss, especially for voxels when facing large-scale scenes. In order to utilize different view's advantages and alleviate their own shortcomings in fine-grained segmentation task, we propose a novel range-point-voxel fusion network, namely RPVNet. In this network, we devise a deep fusion framework with multiple and mutual information interactions among these three views and propose a gated fusion module (termed as GFM), which can adaptively merge the three features based on concurrent inputs. Moreover, the proposed RPV interaction mechanism is highly efficient, and we summarize it into a more general formulation. By leveraging this efficient interaction and relatively lower voxel resolution, our method is also proved to be more efficient. Finally, we evaluated the proposed model on two large-scale datasets, i.e., SemanticKITTI and nuScenes, and it shows state-of-the-art performance on both of them. Note that, our method currently ranks 1st on SemanticKITTI leaderboard without any extra tricks.


title: Structural and Magnetic Transitions in the Planar Antiferromagnet Ba$_4$Ir$_3$O$_{10}$

abstract: We report the structural and magnetic ground state properties of the monoclinic compound barium iridium oxide Ba$_4$Ir$_3$O$_{10}$ using a combination of resonant x-ray scattering, magnetometry, and thermodynamic techniques. Magnetic susceptibility exhibits a pronounced antiferromagnetic transition at $T_{\text{N}}$ $\approx$ 25K, a weaker anomaly at $T_{\text{S}}$ $\approx$ 142K, and strong magnetic anisotropy at all temperatures. Resonant elastic x-ray scattering experiments reveal a second order structural phase transition at $T_{\text{S}}$ and a magnetic transition at $T_{\text{N}}$. Both structural and magnetic superlattice peaks are observed at $L$ = half integer values. The magnetization anomaly at $T_{\text{S}}$ implies the presence of magneto-elastic coupling, which conceivably facilitates the symmetry lowering. Mean field critical scattering is observed above $T_{\text{S}}$. The magnetic structure of the antiferromagnetic ground state is discussed based on the measured magnetic superlattice peak intensity. Our study not only presents essential information for understanding the intertwined structural and magnetic properties in Ba$_4$Ir$_3$O$_{10}$, but also highlights the necessary ingredients for exploring novel ground states with octahedra trimers.


title: On a realization of motion and similarity group equivalence classes of labeled points in $\mathbb R^k$ with applications to computer vision

abstract: We study a realization of motion and similarity group equivalence classes of $n\geq 1$ labeled points in $\mathbb R^k,\, k\geq 1$ as a metric space with a computable metric. Our study is motivated by applications in computer vision.


title: SaccadeCam: Adaptive Visual Attention for Monocular Depth Sensing

abstract: Most monocular depth sensing methods use conventionally captured images that are created without considering scene content. In contrast, animal eyes have fast mechanical motions, called saccades, that control how the scene is imaged by the fovea, where resolution is highest. In this paper, we present the SaccadeCam framework for adaptively distributing resolution onto regions of interest in the scene. Our algorithm for adaptive resolution is a self-supervised network and we demonstrate results for end-to-end learning for monocular depth estimation. We also show preliminary results with a real SaccadeCam hardware prototype.


title: From Semantic Retrieval to Pairwise Ranking: Applying Deep Learning in E-commerce Search

abstract: We introduce deep learning models to the two most important stages in product search at JD.com, one of the largest e-commerce platforms in the world. Specifically, we outline the design of a deep learning system that retrieves semantically relevant items to a query within milliseconds, and a pairwise deep re-ranking system, which learns subtle user preferences. Compared to traditional search systems, the proposed approaches are better at semantic retrieval and personalized ranking, achieving significant improvements.


title: Counterfactual Explanation with Multi-Agent Reinforcement Learning for Drug Target Prediction

abstract: Motivation: Many high-performance DTA models have been proposed, but they are mostly black-box and thus lack human interpretability. Explainable AI (XAI) can make DTA models more trustworthy, and can also enable scientists to distill biological knowledge from the models. Counterfactual explanation is one popular approach to explaining the behaviour of a deep neural network, which works by systematically answering the question "How would the model output change if the inputs were changed in this way?". Most counterfactual explanation methods only operate on single input data. It remains an open problem how to extend counterfactual-based XAI methods to DTA models, which have two inputs, one for drug and one for target, that also happen to be discrete in nature. Methods: We propose a multi-agent reinforcement learning framework, Multi-Agent Counterfactual Drug target binding Affinity (MACDA), to generate counterfactual explanations for the drug-protein complex. Our proposed framework provides human-interpretable counterfactual instances while optimizing both the input drug and target for counterfactual generation at the same time. Results: We benchmark the proposed MACDA framework using the Davis dataset and find that our framework produces more parsimonious explanations with no loss in explanation validity, as measured by encoding similarity and QED. We then present a case study involving ABL1 and Nilotinib to demonstrate how MACDA can explain the behaviour of a DTA model in the underlying substructure interaction between inputs in its prediction, revealing mechanisms that align with prior domain knowledge.


title: A tale of two metrics: Polling and financial contributions as a measure of performance

abstract: Campaign analysis is an integral part of American democracy and has many complexities in its dynamics. Experts have long sought to understand these dynamics and evaluate campaign performance using a variety of techniques. We explore campaign financing and standing in the polls as two components of campaign performance in the context of the 2020 Democratic primaries. We show where these measures exhibit represent similar dynamics and where they differ. We focus on identifying change points in the trend for all candidates using joinpoint regression models. We find how these change points identify major events such as failure or success in a debate. Joinpoint regression reveals who the voters support when they stop supporting a specific candidate. This study demonstrates the value of joinpoint regression in political campaign analysis and it represents a crossover of this technique into the political domain building a foundation for continued exploration and use of this method.


title: The TMRT K Band Observations towards 26 Infrared Dark Clouds: NH$_{3}$, CCS, and HC$_{3}$N

abstract: We present one of the first Shanghai Tian Ma Radio Telescope (TMRT) K Band observations towards a sample of 26 infrared dark clouds (IRDCs). We observed the (1,1), (2,2), (3,3), and (4,4) transitions of NH$_{3}$ together with CCS (2$_{1}$-1$_{0}$) and HC$_{3}$N $J\,$=2-1, simultaneously. The survey dramatically increases the existing CCS-detected IRDC sample from 8 to 23, enabling a better statistical study of the ratios of carbon-chain molecules (CCM) to N-bearing molecules in IRDCs. With the newly developed hyperfine group ratio (HFGR) method of fitting NH$_{3}$ inversion lines, we found the gas temperature to be between 10 and 18 K. The column density ratios of CCS to NH$_{3}$ for most of the IRDCs are less than 10$^{-2}$, distinguishing IRDCs from low-mass star-forming regions. We carried out chemical evolution simulations based on a three-phase chemical model NAUTILUS. Our measurements of the column density ratios between CCM and NH$_{3}$ are consistent with chemical evolutionary ages of $\lesssim$10$^{5}$ yr in the models. Comparisons of the data and chemical models suggest that CCS, HC$_{3}$N, and NH$_{3}$ are sensitive to the chemical evolutionary stages of the sources.


title: A multi-sheath model for highly nonlinear plasma wakefields

abstract: An improved description for nonlinear plasma wakefields with phase velocities near the speed of light is presented and compared against fully kinetic particle-in-cell simulations. These wakefields are excited by intense particle beams or lasers pushing plasma electrons radially outward, creating an ion bubble surrounded by a sheath of electrons characterized by the source term $S \equiv -\frac{1}{en_p}(\rho-J_z/c)$ where $\rho$ and $J_z$ are the charge and axial current densities. Previously, the sheath source term was described phenomenologically with a positive-definite function, resulting in a positive definite wake potential. In reality, the wake potential is negative at the rear of the ion column which is important for self-injection and accurate beam loading models. To account for this, we introduce a multi-sheath model in which the source term, $S$, of the plasma wake can be negative in regions outside the ion bubble. Using this model, we obtain a new expression for the wake potential and a modified differential equation for the bubble radius. Numerical results obtained from these equations are validated against particle-in-cell simulations for unloaded and loaded wakes. The new model provides accurate predictions of the shape and duration of trailing bunch current profiles that flatten plasma wakefields. It is also used to design a trailing bunch for a desired longitudinally varying loaded wakefield. We present beam loading results for laser wakefields and discuss how the model can be improved for laser drivers in future work. Finally, we discuss differences between the predictions of the multi- and single-sheath models for beam loading.


title: Detecting entanglement in arbitrary two-mode Gaussian state: a Stokes-like operator based approach

abstract: Detection of entanglement in quantum states is one of the most important problems in quantum information processing. However, it is one of the most challenging tasks to find a universal scheme which is also desired to be optimal to detect entanglement for all states of a specific class--as always preferred by experimentalists. Although, the topic is well studied at least in case of lower dimensional compound systems, e.g., two-qubit systems, but in the case of continuous variable systems, this remains as an open problem. Even in the case of two-mode Gaussian states, the problem is not fully solved. In our work, we have tried to address this issue. At first, a limited number of Hermitian operators is given to test the necessary and sufficient criterion on the covariance matrix of separable two-mode Gaussian states. Thereafter, we present an interferometric scheme to test the same separability criterion in which the measurements are being done via Stokes-like operators. In such case, we consider only single-copy measurements on a two-mode Gaussian state at a time and the scheme amounts to the full state tomography. Although this latter approach is a linear optics based one, nevertheless it is not an economic scheme. Resource-wise a more economical scheme than the full state tomography is obtained if we consider measurements on two copies of the state at a time. However, optimality of the scheme is not yet known.


title: One to Many: Adaptive Instrument Segmentation via Meta Learning and Dynamic Online Adaptation in Robotic Surgical Video

abstract: Surgical instrument segmentation in robot-assisted surgery (RAS) - especially that using learning-based models - relies on the assumption that training and testing videos are sampled from the same domain. However, it is impractical and expensive to collect and annotate sufficient data from every new domain. To greatly increase the label efficiency, we explore a new problem, i.e., adaptive instrument segmentation, which is to effectively adapt one source model to new robotic surgical videos from multiple target domains, only given the annotated instruments in the first frame. We propose MDAL, a meta-learning based dynamic online adaptive learning scheme with a two-stage framework to fast adapt the model parameters on the first frame and partial subsequent frames while predicting the results. MDAL learns the general knowledge of instruments and the fast adaptation ability through the video-specific meta-learning paradigm. The added gradient gate excludes the noisy supervision from pseudo masks for dynamic online adaptation on target videos. We demonstrate empirically that MDAL outperforms other state-of-the-art methods on two datasets (including a real-world RAS dataset). The promising performance on ex-vivo scenes also benefits the downstream tasks such as robot-assisted suturing and camera control.


title: Relation-aware Instance Refinement for Weakly Supervised Visual Grounding

abstract: Visual grounding, which aims to build a correspondence between visual objects and their language entities, plays a key role in cross-modal scene understanding. One promising and scalable strategy for learning visual grounding is to utilize weak supervision from only image-caption pairs. Previous methods typically rely on matching query phrases directly to a precomputed, fixed object candidate pool, which leads to inaccurate localization and ambiguous matching due to lack of semantic relation constraints. In our paper, we propose a novel context-aware weakly-supervised learning method that incorporates coarse-to-fine object refinement and entity relation modeling into a two-stage deep network, capable of producing more accurate object representation and matching. To effectively train our network, we introduce a self-taught regression loss for the proposal locations and a classification loss based on parsed entity relations. Extensive experiments on two public benchmarks Flickr30K Entities and ReferItGame demonstrate the efficacy of our weakly grounding framework. The results show that we outperform the previous methods by a considerable margin, achieving 59.27\% top-1 accuracy in Flickr30K Entities and 37.68\% in the ReferItGame dataset respectively (Code is available at https://github.com/youngfly11/ReIR-WeaklyGrounding.pytorch.git).


title: Moduli of Canonical Surfaces of General Type with $K_S^2 = 1$, $p_g = 2$

abstract: We study the moduli space of minimal surfaces of general type with $K_S^2 = 1$ and $p_g = 2$ and show that it is irreducible, has dimension $28$ and admits a compactification which is unirational.


title: MLAN: Multi-Level Adversarial Network for Domain Adaptive Semantic Segmentation

abstract: Recent progresses in domain adaptive semantic segmentation demonstrate the effectiveness of adversarial learning (AL) in unsupervised domain adaptation. However, most adversarial learning based methods align source and target distributions at a global image level but neglect the inconsistency around local image regions. This paper presents a novel multi-level adversarial network (MLAN) that aims to address inter-domain inconsistency at both global image level and local region level optimally. MLAN has two novel designs, namely, region-level adversarial learning (RL-AL) and co-regularized adversarial learning (CR-AL). Specifically, RL-AL models prototypical regional context-relations explicitly in the feature space of a labelled source domain and transfers them to an unlabelled target domain via adversarial learning. CR-AL fuses region-level AL and image-level AL optimally via mutual regularization. In addition, we design a multi-level consistency map that can guide domain adaptation in both input space ($i.e.$, image-to-image translation) and output space ($i.e.$, self-training) effectively. Extensive experiments show that MLAN outperforms the state-of-the-art with a large margin consistently across multiple datasets.


title: Non-Compression Auto-Encoder for Detecting Road Surface Abnormality via Vehicle Driving Noise

abstract: Road accident can be triggered by wet road because it decreases skid resistance. To prevent the road accident, detecting road surface abnomality is highly useful. In this paper, we propose the deep learning based cost-effective real-time anomaly detection architecture, naming with non-compression auto-encoder (NCAE). The proposed architecture can reflect forward and backward causality of time series information via convolutional operation. Moreover, the above architecture shows higher anomaly detection performance of published anomaly detection model via experiments. We conclude that NCAE as a cutting-edge model for road surface anomaly detection with 4.20\% higher AUROC and 2.99 times faster decision than before.


title: Analysis of QoS in Heterogeneous Networks with Clustered Deployment and Caching Aware Capacity Allocation

abstract: In cellular networks, the densification of connected devices and base stations engender the ever-growing traffic intensity, and caching popular contents with smart management is a promising way to alleviate such consequences. Our research extends the previously proposed analysis of three-tier cache enabled Heterogeneous Networks (HetNets). The main contributions are threefold. We consider the more realistic assumption; that is, the distribution of small base stations is following Poisson-Poisson cluster processes, which reflects the real situations of geographic restriction, user dense areas, and coverage-holes. We propose the allocation of downlink data transmission capacity according to the cases of requested contents which are either cached or non-cached in nearby nodes and elucidate the traffic efficiency of the allocation under the effect of clustered deployment of small base stations. The throughput and delay of the allocation system are derived based on the approximated sojourn time of the Discriminatory Processor Sharing (DPS) queue. We present the results of achievable efficiency and such a system's performance for a better caching solution to the challenges of future cellular networks.


title: Search for lepton-flavor-violating tau-lepton decays to $\ell\gamma$ at Belle

abstract: Charged lepton flavor violation is forbidden in the Standard Model but possible in several new physics scenarios. In many of these models, the radiative decays $\tau^{\pm}\rightarrow\ell^{\pm}\gamma$ ($\ell=e,\mu$) are predicted to have a sizeable probability, making them particularly interesting channels to search at various experiments. An updated search via $\tau^{\pm}\rightarrow\ell^{\pm}\gamma$ using full data of the Belle experiment, corresponding to an integrated luminosity of 988 fb$^{-1}$, is reported for charged lepton flavor violation. No significant excess over background predictions from the Standard Model is observed, and the upper limits on the branching fractions, $\mathcal{B}(\tau^{\pm}\rightarrow \mu^{\pm}\gamma)$ $\leq$ $4.2\times10^{-8}$ and $\mathcal{B}(\tau^{\pm}\rightarrow e^{\pm}\gamma)$ $\leq$ $5.6\times10^{-8}$, are set at 90\% confidence level.


title: MANAS: Multi-Scale and Multi-Level Neural Architecture Search for Low-Dose CT Denoising

abstract: Lowering the radiation dose in computed tomography (CT) can greatly reduce the potential risk to public health. However, the reconstructed images from the dose-reduced CT or low-dose CT (LDCT) suffer from severe noise, compromising the subsequent diagnosis and analysis. Recently, convolutional neural networks have achieved promising results in removing noise from LDCT images; the network architectures used are either handcrafted or built on top of conventional networks such as ResNet and U-Net. Recent advance on neural network architecture search (NAS) has proved that the network architecture has a dramatic effect on the model performance, which indicates that current network architectures for LDCT may be sub-optimal. Therefore, in this paper, we make the first attempt to apply NAS to LDCT and propose a multi-scale and multi-level NAS for LDCT denoising, termed MANAS. On the one hand, the proposed MANAS fuses features extracted by different scale cells to capture multi-scale image structural details. On the other hand, the proposed MANAS can search a hybrid cell- and network-level structure for better performance. Extensively experimental results on three different dose levels demonstrate that the proposed MANAS can achieve better performance in terms of preserving image structural details than several state-of-the-art methods. In addition, we also validate the effectiveness of the multi-scale and multi-level architecture for LDCT denoising.


title: Resonant Scanning Design and Control for Fast Spatial Sampling

abstract: Two-dimensional, resonant scanners have been utilized in a large variety of imaging modules due to their compact form, low power consumption, large angular range, and high speed. However, resonant scanners have problems with non-optimal and inflexible scanning patterns and inherent phase uncertainty, which limit practical applications. Here we propose methods for optimized design and control of the scanning trajectory of two-dimensional resonant scanners under various physical constraints, including high frame-rate and limited actuation amplitude. First, we propose an analytical design rule for uniform spatial sampling. We demonstrate theoretically and experimentally that by including non-repeating scanning patterns, the proposed designs outperform previous designs in terms of scanning range and fill factor. Second, we show that we can create flexible scanning patterns that allow focusing on user-defined Regions-of-Interest (RoI) by modulation of the scanning parameters. The scanning parameters are found by an optimization algorithm. In simulations, we demonstrate the benefits of these designs with standard metrics and higher-level computer vision tasks (LiDAR odometry and 3D object detection). Finally, we experimentally implement and verify both unmodulated and modulated scanning modes using a two-dimensional, resonant MEMS scanner. Central to the implementations is high bandwidth monitoring of the phase of the angular scans in both dimensions. This task is carried out with a position-sensitive photodetector combined with high-bandwidth electronics, enabling fast spatial sampling at ~ 100Hz frame-rate.


title: From Shadow Generation to Shadow Removal

abstract: Shadow removal is a computer-vision task that aims to restore the image content in shadow regions. While almost all recent shadow-removal methods require shadow-free images for training, in ECCV 2020 Le and Samaras introduces an innovative approach without this requirement by cropping patches with and without shadows from shadow images as training samples. However, it is still laborious and time-consuming to construct a large amount of such unpaired patches. In this paper, we propose a new G2R-ShadowNet which leverages shadow generation for weakly-supervised shadow removal by only using a set of shadow images and their corresponding shadow masks for training. The proposed G2R-ShadowNet consists of three sub-networks for shadow generation, shadow removal and refinement, respectively and they are jointly trained in an end-to-end fashion. In particular, the shadow generation sub-net stylises non-shadow regions to be shadow ones, leading to paired data for training the shadow-removal sub-net. Extensive experiments on the ISTD dataset and the Video Shadow Removal dataset show that the proposed G2R-ShadowNet achieves competitive performances against the current state of the arts and outperforms Le and Samaras' patch-based shadow-removal method.


title: Including Sparse Production Knowledge into Variational Autoencoders to Increase Anomaly Detection Reliability

abstract: Digitalization leads to data transparency for production systems that we can benefit from with data-driven analysis methods like neural networks. For example, automated anomaly detection enables saving resources and optimizing the production. We study using rarely occurring information about labeled anomalies into Variational Autoencoder neural network structures to overcome information deficits of supervised and unsupervised approaches. This method outperforms all other models in terms of accuracy, precision, and recall. We evaluate the following methods: Principal Component Analysis, Isolation Forest, Classifying Neural Networks, and Variational Autoencoders on seven time series datasets to find the best performing detection methods. We extend this idea to include more infrequently occurring meta information about production processes. This use of sparse labels, both of anomalies or production data, allows to harness any additional information available for increasing anomaly detection performance.


title: Discriminator Augmented Model-Based Reinforcement Learning

abstract: By planning through a learned dynamics model, model-based reinforcement learning (MBRL) offers the prospect of good performance with little environment interaction. However, it is common in practice for the learned model to be inaccurate, impairing planning and leading to poor performance. This paper aims to improve planning with an importance sampling framework that accounts and corrects for discrepancy between the true and learned dynamics. This framework also motivates an alternative objective for fitting the dynamics model: to minimize the variance of value estimation during planning. We derive and implement this objective, which encourages better prediction on trajectories with larger returns. We observe empirically that our approach improves the performance of current MBRL algorithms on two stochastic control problems, and provide a theoretical basis for our method.


title: Effect of Electric Fields on the Director Field and Shape of Nematic Tactoids

abstract: Tactoids are spindle shaped-droplets of a uniaxial nematic phase suspended in the co-existing isotropic phase. They are found in dispersions of a wide variety of elongated colloidal particles, including actin, fd virus, carbon nanotubes, vanadium peroxide and chitin nanocrystals. Recent experiments on tactoids of chitin nanocrystals in water show that electric fields can very strongly elongate tactoids even though the dielectric properties of the co-existing isotropic and nematic phases differ only subtly. We develop a model for partially bipolar tactoids, where the degree of bipolarness of the director field is free to adjust to optimize the sum of the elastic, surface and Coulomb energies of the system. By means of a combination of a scaling analysis and a numerical study, we investigate the elongation and director field's behavior of the tactoids as a function of their size, the strength of the electric field, the surface tension, anchoring strength, the elastic constants and the electric susceptibility anisotropy. We find that tactoids cannot elongate significantly due to an external electric field, unless the director field is bipolar or quasi bipolar and is somehow frozen in the field-free configuration. Presuming that this is the case, we find reasonable agreement with experimental data.


title: X-view: Non-egocentric Multi-View 3D Object Detector

abstract: 3D object detection algorithms for autonomous driving reason about 3D obstacles either from 3D birds-eye view or perspective view or both. Recent works attempt to improve the detection performance via mining and fusing from multiple egocentric views. Although the egocentric perspective view alleviates some weaknesses of the birds-eye view, the sectored grid partition becomes so coarse in the distance that the targets and surrounding context mix together, which makes the features less discriminative. In this paper, we generalize the research on 3D multi-view learning and propose a novel multi-view-based 3D detection method, named X-view, to overcome the drawbacks of the multi-view methods. Specifically, X-view breaks through the traditional limitation about the perspective view whose original point must be consistent with the 3D Cartesian coordinate. X-view is designed as a general paradigm that can be applied on almost any 3D detectors based on LiDAR with only little increment of running time, no matter it is voxel/grid-based or raw-point-based. We conduct experiments on KITTI and NuScenes datasets to demonstrate the robustness and effectiveness of our proposed X-view. The results show that X-view obtains consistent improvements when combined with four mainstream state-of-the-art 3D methods: SECOND, PointRCNN, Part-A^2, and PV-RCNN.


title: A positivity preserving numerical scheme for the alpha-CEV process

abstract: In this article, we present a method to construct a positivity-preserving numerical scheme for a jump-extended CEV (Constant Elasticity of Variance) process, whose jumps are governed by a spectrally positive $\alpha$-stable process with $\alpha \in (1,2)$. The numerical scheme is obtained by making the diffusion coefficient $x^\gamma$, where $\gamma \in (\frac{1}{2},1)$, partially implicit and then finding the appropriate adjustment factor. We show that, for sufficiently small step size, the proposed scheme converges and theoretically achieves a strong convergence rate of at least $\frac{1}{2}\left(\frac{\alpha_-}{2} \wedge \frac{1}{\alpha}\wedge \rho\right)$, where $\rho \in (\frac{1}{2},1)$ is the H\"older exponent of the jump coefficient $x^\rho$ and the constant $\alpha_- < \alpha$ can be chosen arbitrarily close to $\alpha \in (1,2)$.


title: Industrial Machine Tool Component Surface Defect Dataset

abstract: Using machine learning (ML) techniques in general and deep learning techniques in specific needs a certain amount of data often not available in large quantities in technical domains. The manual inspection of machine tool components and the manual end-of-line check of products are labor-intensive tasks in industrial applications that companies often want to automate. To automate classification processes and develop reliable and robust machine learning-based classification and wear prognostics models, one needs real-world datasets to train and test the models. The dataset is available under https://doi.org/10.5445/IR/1000129520.


title: On the $ C^{8/3} $-Regularisation of Simultaneous Binary Collisions in the Planar 4-Body Problem

abstract: The dynamics of the 4-body problem allows for two binary collisions to occur simultaneously. It is known that in the collinear 4-body problem this simultaneous binary collision (SBC) can be block-regularised, but that the resulting block map is only $C^{8/3}$ differentiable. In this paper, it is proved that the $C^{8/3}$ differentiability persists for the SBC in the planar 4-body problem. The proof uses several geometric tools, namely, blow-up, normal forms, dynamics near normally hyperbolic manifolds of equilibrium points, and Dulac maps.


title: On analyticity up to the boundary for critical quasi-geostrophic equations

abstract: We study the Cauchy problem for the quasi-geostrophic equations with the critical dissipation in the two dimensional half space under the homogeneous Dirichlet boundary condition. We show the global existence, the uniqueness and the analyticity of solutions, and the real analyticity up to the boundary is obtained. We will show one of natural ways to estimate the nonlinear term for functions satisfying the Dirichlet boundary condition.


title: A Marker-free Head Tracker Using Vision-based Head Pose Estimation with Adaptive Kalman Filter

abstract: The immersion and the interaction are the important features of the driving simulator. To improve these characteristics, this paper proposes a low-cost and mark-less driver head tracking framework based on the head pose estimation model, which makes the view of the simulator can automatically align with the driver's head pose. The proposed method only uses the RGB camera without the other hardware or marker. To handle the error of the head pose estimation model, this paper proposes an adaptive Kalman Filter. By analyzing the error distribution of the estimation model and user experience, the proposed Kalman Filter includes the adaptive observation noise coefficient and loop closure module, which can adaptive moderate the smoothness of the curve and keep the curve stable near the initial position. The experiments show that the proposed method is feasible, and it can be used with different head pose estimation models.


title: Squeezed spectra of bosons and antibosons with different in-medium masses

abstract: We study the influence of the in-medium mass difference between boson and antiboson on their spectra. The in-medium mass difference may lead to a difference between the transverse momentum spectra of boson and antiboson. This effect increases with the increasing in-medium mass difference between boson and antiboson. The difference between the transverse momentum spectra of boson and antiboson increases with the increasing expanding velocity of the source and decreases with the increasing transverse momentum in large transverse mass region (mT > 1:6 GeV). The interactions between the hadron and the medium may increase with the increasing temperature of the medium and the higher freeze-out temperature may lead to a larger mass difference between boson and antiboson, and may give rise to a larger difference between the transverse momentum spectra of boson and antiboson for higher freeze-out temperature.


title: Tunnelling of transverse acoustic waves on a silicon chip

abstract: Nanomechanical circuits for transverse acoustic waves promise to enable new approaches to computing, precision biochemical sensing and many other applications. However, progress is hampered by the lack of precise control of the coupling between nanomechanical elements. Here, we demonstrate virtual-phonon coupling between transverse mechanical elements, exploiting tunnelling through a zero-mode acoustic barrier. This allows the construction of large-scale nanomechanical circuits on a silicon chip, for which we develop a new scalable fabrication technique. As example applications, we build mode-selective acoustic mirrors with controllable reflectivity and demonstrate acoustic spatial mode filtering. Our work paves the way towards applications such as fully nanomechanical computer processors and distributed nanomechanical sensors, and to explore the rich landscape of nonlinear nanomechanical dynamics.


title: UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark

abstract: Commonsense AI has long been seen as a near impossible goal -- until recently. Now, research interest has sharply increased with an influx of new benchmarks and models. We propose two new ways to evaluate commonsense models, emphasizing their generality on new tasks and building on diverse, recently introduced benchmarks. First, we propose a new multitask benchmark, RAINBOW, to promote research on commonsense models that generalize well over multiple tasks and datasets. Second, we propose a novel evaluation, the cost equivalent curve, that sheds new insight on how the choice of source datasets, pretrained language models, and transfer learning methods impacts performance and data efficiency. We perform extensive experiments -- over 200 experiments encompassing 4800 models -- and report multiple valuable and sometimes surprising findings, e.g., that transfer almost always leads to better or equivalent performance if following a particular recipe, that QA-based commonsense datasets transfer well with each other, while commonsense knowledge graphs do not, and that perhaps counter-intuitively, larger models benefit more from transfer than smaller ones. Last but not least, we introduce a new universal commonsense reasoning model, UNICORN, that establishes new state-of-the-art performance across 8 popular commonsense benchmarks, aNLI (87.3%), CosmosQA (91.8%), HellaSWAG (93.9%), PIQA (90.1%), SocialIQa (83.2%), WinoGrande (86.6%), CycIC (94.0%) and CommonsenseQA (79.3%).


title: A branch-and-price algorithm for the robust single-source capacitated facility location problem under demand uncertainty

abstract: We consider the robust single-source capacitated facility location problem with uncertainty in customer demands. A cardinality-constrained uncertainty set is assumed for the robust problem. To solve it efficiently, we propose an allocation-based formulation derived by Dantzig-Wolfe decomposition and a branch-and-price algorithm. The computational experiments show that our branch-and-price algorithm outperforms CPLEX in many cases, which solves the ordinary robust reformulation. We also examine the trade-off relationship between the empirical probability of infeasibility and the additional costs incurred and observe that the robustness of solutions can be improved significantly with small additional costs.


title: Chiral non-Abelian vortices and their confinement in three flavor dense QCD

abstract: We find chiral non-Abelian vortices having windings only in one of the diquark condensations of left-handed and right-handed quarks in the color-flavor locked phase of dense QCD. They are the minimum vortices carrying half color magnetic fluxes of those of non-Abelian semi-superfluid vortices (color magnetic flux tubes) and 1/6 quantized superfluid circulations of Abelian superfluid vortices. These vortices carry ${\mathbb C}P^2$ orientational moduli in the internal space corresponding to their fluxes. The ${\mathbb C}P^2$ moduli of two chiral non-Abelian vortices with chiralities opposite to each other are energetically favored to be aligned while those of a vortex and anti-vortex to be orthogonal, and then these vortices attract each other. They are attached by chiral domain walls in the presence of the mass and axial anomaly terms explicitly breaking axial and chiral symmetries. We numerically show that two chiral non-Abelian vortices with chiralities opposite to each other are connected by a chiral domain wall, consisting a mesonic bound state which is nothing but a non-Abelian semi-superfluid vortex. We also show that Abelian and non-Abelian axial vortices attached by chiral domain walls are all unstable to decay into a set of chiral non-Abelian vortices. Furthermore, we find that chiral non-Abelian vortices exhibit unique features: one is the so-called topological obstruction implying that unbroken symmetry generators in the bulk are not defined globally around the vortices, and the other is color non-singlet Aharonov-Bohm (AB) phases implying that quarks encircling these vortices can detect the colors of magnetic fluxes of them at infinite distances.


title: Anoxic Atmospheres on Mars Driven by Volcanism: Implications for Past Environments and Life

abstract: Mars today has no active volcanism and its atmosphere is oxidizing, dominated by the photochemistry of CO2 and H2O. Using a one-dimensional photochemical model, we consider whether plausible volcanic gas fluxes could have switched the redox-state of the past martian atmosphere to reducing conditions. In our model, the total quantity and proportions of volcanic gases depend on the water content, outgassing pressure, and oxygen fugacity of the source melt. We find that with reasonable melt parameters the past martian atmosphere (~3.5 Gyr to present) could have easily reached reducing and anoxic conditions with modest levels of volcanism, >0.14 km^3/yr, well within the range of prior estimates. Counter-intuitively we also find that more reducing melts with lower oxygen fugacity require greater amounts of volcanism to switch a paleo-atmosphere from oxidizing to reducing. The reason is that sulfur is more stable in such melts and lower absolute fluxes of sulfur-bearing gases more than compensate for increases in the proportions of H2 and CO. These results imply that ancient Mars should have experienced periods with anoxic and reducing atmospheres even through the mid-Amazonian whenever volcanic outgassing was sustained at sufficient levels. Reducing anoxic conditions are potentially conducive to the synthesis of prebiotic organic compounds, such as amino acids, and are therefore relevant to the possibility of life on Mars. Also, anoxic reducing conditions should have influenced the type of minerals that were formed on the surface or deposited from the atmosphere such as elemental polysulfur (S8) as a signature of past reducing atmospheres. Finally, our models allow us to estimate the amount of volcanically sourced atmospheric sulfate deposited over Mars' history, approximately 10^6 to 10^9 Tmol, with a spread depending on assumed outgassing rate history and magmatic source conditions.


title: A Multi-parameter Persistence Framework for Mathematical Morphology

abstract: The field of mathematical morphology offers well-studied techniques for image processing. In this work, we view morphological operations through the lens of persistent homology, a tool at the heart of the field of topological data analysis. We demonstrate that morphological operations naturally form a multiparameter filtration and that persistent homology can then be used to extract information about both topology and geometry in the images as well as to automate methods for optimizing the study and rendering of structure in images. For illustration, we apply this framework to analyze noisy binary, grayscale, and color images.


title: Enhanced Robust Adaptive Beamforming Designs for General-Rank Signal Model via an Induced Norm of Matrix Errors

abstract: The robust adaptive beamforming (RAB) problem for general-rank signal model with an uncertainty set defined through a matrix induced norm is considered. The worst-case signal-to-interference-plus-noise ratio (SINR) maximization RAB problem is formulated by decomposing the presumed covariance of the desired signal into a product between a matrix and its Hermitian, and putting an error term into the matrix and its Hermitian. In the literature, the norm of the matrix errors often is the Frobenius norm in the maximization problem. Herein, the closed-form optimal value for a minimization problem of the least-squares residual over the matrix errors with an induced $l_{p,q}$-norm constraint is first derived. Then, the worst-case SINR maximization problem is reformulated into the maximization of the difference between an $l_2$-norm function and a $l_q$-norm function, subject to a convex quadratic constraint. It is shown that for any $q$ in the set of rational numbers greater than or equal to one, the maximization problem can be approximated by a sequence of second-order cone programming (SOCP) problems, with the ascent optimal values. The resultant beamvector for some $q$ in the set, corresponding to the maximal actual array output SINR, is treated as the best candidate such that the RAB design is improved the most. In addition, a generalized RAB problem of maximizing the difference between an $l_p$-norm function and an $l_q$-norm function subject to the convex quadratic constraint is studied, and the actual array output SINR is further enhanced by properly selecting $p$ and $q$. Simulation examples are presented to demonstrate the improved performance of the robust beamformers for certain matrix induced $l_{p,q}$-norms, in terms of the actual array output SINR and the CPU-time for the sequential SOCP approximation algorithm.


title: Finding gravitational-wave black holes with parallax microlensing

abstract: The LIGO-Virgo gravitational-wave (GW) observation unveiled the new population of black holes (BHs) that appears to have an extended mass spectrum up to around $70M_\odot$, much heavier than the previously-believed mass range ($\sim 8M_\odot$). In this paper, we study the capability of a microlensing observation of stars in the Milky Way (MW) bulge region to identify BHs of GW mass scales, taking into account the microlensing parallax characterized by the parameter $\pi_{\rm E}\propto M^{-1/2}$ ($M$ is the mass of a lens), which is a dimension-less quantity defined by the ratio of the astronomical unit to the projected Einstein radius. First, assuming that BHs follow the same spatial and velocity distributions of stars as predicted by the standard MW model, we show that microlensing events with long light curve timescales, $t_{\rm E}\gtrsim 100~{\rm days}$, and small parallax effects, $\pi_{\rm E}\sim 10^{-2}$, are dominated by BH lenses compared to stellar-mass lenses. Second, using a Markov chain Monte Carlo analysis of the simulated light curve, we show that BH lens candidates are securely identified on individual basis, if the parallax effect is detected or well constrained to the precision of a percent level in $\pi_{\rm E}$. We also discuss that a microlensing event of an intermediate-mass BH of $\sim 1000M_\odot$, if it occurs, can be identified in a distinguishable way from stellar-mass BHs.


title: Stability, convergence and bifurcation in some models of chemical kinetics

abstract: In this paper, we analyze the stability, convergence, and bifurcation properties of the Boissonade-De Kepper (BD) model which played a key role in the development of nonlinear chemical dynamics. We first outline conditions for local stability, which may help guide design considerations. Then, we show that the BD model undergoes a Hopf bifurcation when the stability condition gets violated. Using Poincar\'{e} normal forms and center manifold theory, we derive explicit analytic expressions for determining the type of the Hopf bifurcation and the stability of the limit cycles. This provides insights on the system dynamics just beyond the stable regime. Some of the analytical insights are corroborated with numerical computations. We also show that the mathematical results obtained in this paper may have wider applicability beyond the BD model.


title: Peak Estimation for Uncertain and Switched Systems

abstract: Peak estimation bounds extreme values of a function of state along trajectories of a dynamical system. This paper focuses on extending peak estimation to continuous and discrete settings with time-independent and time-dependent uncertainty. Techniques from optimal control are used to incorporate uncertainty into an existing occupation measure-based peak estimation framework, which includes special consideration for handling switching uncertainties. The resulting infinite-dimensional linear programs can be solved approximately with Linear Matrix Inequalities arising from the moment-SOS hierarchy.


title: Noise Detection with Spectator Qubits and Quantum Feature Engineering

abstract: Designing optimal control pulses that drive a noisy qubit to a target state is a challenging and crucial task for quantum engineering. In a situation where the properties of the quantum noise affecting the system are dynamic, a periodic characterization procedure is essential to ensure the models are updated. As a result, the operation of the qubit is disrupted frequently. In this paper, we propose a protocol that addresses this challenge by making use of a spectator qubit to monitor the noise in real-time. We develop a machine-learning-based quantum feature engineering approach for designing the protocol. The complexity of the protocol is front-loaded in a characterization phase, which allow real-time execution during the quantum computations. We present the results of numerical simulations that showcase the favorable performance of the protocol.


title: Topic Modeling Genre: An Exploration of French Classical and Enlightenment Drama

abstract: The concept of literary genre is a highly complex one: not only are different genres frequently defined on several, but not necessarily the same levels of description, but consideration of genres as cognitive, social, or scholarly constructs with a rich history further complicate the matter. This contribution focuses on thematic aspects of genre with a quantitative approach, namely Topic Modeling. Topic Modeling has proven to be useful to discover thematic patterns and trends in large collections of texts, with a view to class or browse them on the basis of their dominant themes. It has rarely if ever, however, been applied to collections of dramatic texts. In this contribution, Topic Modeling is used to analyze a collection of French Drama of the Classical Age and the Enlightenment. The general aim of this contribution is to discover what semantic types of topics are found in this collection, whether different dramatic subgenres have distinctive dominant topics and plot-related topic patterns, and inversely, to what extent clustering methods based on topic scores per play produce groupings of texts which agree with more conventional genre distinctions. This contribution shows that interesting topic patterns can be detected which provide new insights into the thematic, subgenre-related structure of French drama as well as into the history of French drama of the Classical Age and the Enlightenment.


title: deGraphCS: Embedding Variable-based Flow Graph for Neural Code Search

abstract: With the rapid increase in the amount of public code repositories, developers maintain a great desire to retrieve precise code snippets by using natural language. Despite existing deep learning based approaches(e.g., DeepCS and MMAN) have provided the end-to-end solutions (i.e., accepts natural language as queries and shows related code fragments retrieved directly from code corpus), the accuracy of code search in the large-scale repositories is still limited by the code representation (e.g., AST) and modeling (e.g., directly fusing the features in the attention stage). In this paper, we propose a novel learnable deep Graph for Code Search (calleddeGraphCS), to transfer source code into variable-based flow graphs based on the intermediate representation technique, which can model code semantics more precisely compared to process the code as text directly or use the syntactic tree representation. Furthermore, we propose a well-designed graph optimization mechanism to refine the code representation, and apply an improved gated graph neural network to model variable-based flow graphs. To evaluate the effectiveness of deGraphCS, we collect a large-scale dataset from GitHub containing 41,152 code snippets written in C language, and reproduce several typical deep code search methods for comparison. Besides, we design a qualitative user study to verify the practical value of our approach. The experimental results have shown that deGraphCS can achieve state-of-the-art performances, and accurately retrieve code snippets satisfying the needs of the users.


title: Convex Online Video Frame Subset Selection using Multiple Criteria for Data Efficient Autonomous Driving

abstract: Training vision-based Urban Autonomous driving models is a challenging problem, which is highly researched in recent times. Training such models is a data-intensive task requiring the storage and processing of vast volumes of (possibly redundant) driving video data. In this paper, we study the problem of developing data-efficient autonomous driving systems. In this context, we study the problem of multi-criteria online video frame subset selection. We study convex optimization-based solutions and show that they are unable to provide solutions with high weightage to the loss of selected video frames. We design a novel convex optimization-based multi-criteria online subset selection algorithm that uses a thresholded concave function of selection variables. We also propose and study a submodular optimization-based algorithm. Extensive experiments using the driving simulator CARLA show that we are able to drop 80% of the frames while succeeding to complete 100% of the episodes w.r.t. the model trained on 100% data, in the most difficult task of taking turns. This results in a training time of less than 30% compared to training on the whole dataset. We also perform detailed experiments on prediction performances of various affordances used by the Conditional Affordance Learning (CAL) model and show that our subset selection improves performance on the crucial affordance "Relative Angle" during turns.


title: beta-Ga2O3 Double Gate Junctionless FET with an Efficient Volume Depletion Region

abstract: This paper presents a new \b{eta}-Ga2O3 junctionless double gate Metal-Oxide-Field-Semiconductor-Effect-Transistor (\b{eta}DG-JL-FET) that a P+ packet embedded in the oxide layer (PO-\b{eta}DG-JL-FET) for high-voltage applications. Our goal is to achieve an efficient volume depletion region by placing a P+ layer of silicon. We show that the proposed structure has a subthreshold swing ~ 64 mV/decade and it suppressed the band to band tunneling (BTBT) phenomenon. Also, the PO-\b{eta}DG-JL-FET structure has a high Ion/Ioff ~ 1.3e15. The embedded layer reduces the off-current (IOFF) by ~ 10-4, while the on-current (ION) reduces slightly. Besides, we show that the proposed structure has acceptable Ioff value in a range of gate work functions which help us to the optimization of designs in terms of area, power gain, and leakage current. The leakage current of the proposed structure is ~ 7e-17 A in 400 K temperature. Furthermore, the fabrication process steps of the proposed structure will be investigated.


title: Can Vision Transformers Learn without Natural Images?

abstract: Can we complete pre-training of Vision Transformers (ViT) without natural images and human-annotated labels? Although a pre-trained ViT seems to heavily rely on a large-scale dataset and human-annotated labels, recent large-scale datasets contain several problems in terms of privacy violations, inadequate fairness protection, and labor-intensive annotation. In the present paper, we pre-train ViT without any image collections and annotation labor. We experimentally verify that our proposed framework partially outperforms sophisticated Self-Supervised Learning (SSL) methods like SimCLRv2 and MoCov2 without using any natural images in the pre-training phase. Moreover, although the ViT pre-trained without natural images produces some different visualizations from ImageNet pre-trained ViT, it can interpret natural image datasets to a large extent. For example, the performance rates on the CIFAR-10 dataset are as follows: our proposal 97.6 vs. SimCLRv2 97.4 vs. ImageNet 98.0.


title: Online Stochastic Matching, Poisson Arrivals, and the Natural Linear Program

abstract: We study the online stochastic matching problem. Consider a bipartite graph with offline vertices on one side, and with i.i.d.online vertices on the other side. The offline vertices and the distribution of online vertices are known to the algorithm beforehand. The realization of the online vertices, however, is revealed one at a time, upon which the algorithm immediately decides how to match it. For maximizing the cardinality of the matching, we give a $0.711$-competitive online algorithm, which improves the best previous ratio of $0.706$. When the offline vertices are weighted, we introduce a $0.7009$-competitive online algorithm for maximizing the total weight of the matched offline vertices, which improves the best previous ratio of $0.662$. Conceptually, we find that the analysis of online algorithms simplifies if the online vertices follow a Poisson process, and establish an approximate equivalence between this Poisson arrival model and online stochstic matching. Technically, we propose a natural linear program for the Poisson arrival model, and demonstrate how to exploit its structure by introducing a converse of Jensen's inequality. Moreover, we design an algorithmic amortization to replace the analytic one in previous work, and as a result get the first vertex-weighted online stochastic matching algorithm that improves the results in the weaker random arrival model.


title: Supercritical linear dilaton capping state using Interpolating functions

abstract: We consider time dependent backgrounds with a time-like linear dilaton which leads to a weakly coupled theory at asymptotic future known as the Supercritical Linear Dilaton (SCLD) phase. Even after projecting out the tachyon there are naive divergences in the partition function due to the spectrum of relevant deformations. Although the partition function seems divergent, the background is actually well defined in the far future due to vanishing backreactions, provided we start from an appropriate initial state called the "capping" state. We use the technique of interpolating functions to construct this state by embedding the SCLD phase in a strong coupling completion of string theory. Although we are unable construct a specific example, we do provide the general strategy in cases where S-duality may provide the completion.


title: The Gradient Convergence Bound of Federated Multi-Agent Reinforcement Learning with Efficient Communication

abstract: The paper considers independent reinforcement learning (IRL) for multi-agent collaborative decision-making in the paradigm of federated learning (FL). However, FL generates excessive communication overheads between agents and a remote central server, especially when it involves a large number of agents or iterations. Besides, due to the heterogeneity of independent learning environments, multiple agents may undergo asynchronous Markov decision processes (MDPs), which will affect the training samples and the model's convergence performance. On top of the variation-aware periodic averaging (VPA) method and the policy-based deep reinforcement learning (DRL) algorithm (i.e., proximal policy optimization (PPO)), this paper proposes two advanced optimization schemes orienting to stochastic gradient descent (SGD): 1) A decay-based scheme gradually decays the weights of a model's local gradients with the progress of successive local updates, and 2) By representing the agents as a graph, a consensus-based scheme studies the impact of exchanging a model's local gradients among nearby agents from an algebraic connectivity perspective. This paper also provides novel convergence guarantees for both developed schemes, and demonstrates their superior effectiveness and efficiency in improving the system's utility value through theoretical analyses and simulation results.


title: AutoMix: Unveiling the Power of Mixup for Stronger Classifiers

abstract: Data mixing augmentation have proved to be effective in improving the generalization ability of deep neural networks. While early methods mix samples by hand-crafted policies (e.g., linear interpolation), recent methods utilize saliency information to match the mixed samples and labels via complex offline optimization. However, there arises a trade-off between precise mixing policies and optimization complexity. To address this challenge, we propose a novel automatic mixup (AutoMix) framework, where the mixup policy is parameterized and serves the ultimate classification goal directly. Specifically, AutoMix reformulates the mixup classification into two sub-tasks (i.e., mixed sample generation and mixup classification) with corresponding sub-networks and solves them in a bi-level optimization framework. For the generation, a learnable lightweight mixup generator, Mix Block, is designed to generate mixed samples by modeling patch-wise relationships under the direct supervision of the corresponding mixed labels. To prevent the degradation and instability of bi-level optimization, we further introduce a momentum pipeline to train AutoMix in an end-to-end manner. Extensive experiments on nine image benchmarks prove the superiority of AutoMix compared with state-of-the-art in various classification scenarios and downstream tasks.


title: Lightweight Image Super-Resolution with Multi-scale Feature Interaction Network

abstract: Recently, the single image super-resolution (SISR) approaches with deep and complex convolutional neural network structures have achieved promising performance. However, those methods improve the performance at the cost of higher memory consumption, which is difficult to be applied for some mobile devices with limited storage and computing resources. To solve this problem, we present a lightweight multi-scale feature interaction network (MSFIN). For lightweight SISR, MSFIN expands the receptive field and adequately exploits the informative features of the low-resolution observed images from various scales and interactive connections. In addition, we design a lightweight recurrent residual channel attention block (RRCAB) so that the network can benefit from the channel attention mechanism while being sufficiently lightweight. Extensive experiments on some benchmarks have confirmed that our proposed MSFIN can achieve comparable performance against the state-of-the-arts with a more lightweight model.


title: Jo-SRC: A Contrastive Approach for Combating Noisy Labels

abstract: Due to the memorization effect in Deep Neural Networks (DNNs), training with noisy labels usually results in inferior model performance. Existing state-of-the-art methods primarily adopt a sample selection strategy, which selects small-loss samples for subsequent training. However, prior literature tends to perform sample selection within each mini-batch, neglecting the imbalance of noise ratios in different mini-batches. Moreover, valuable knowledge within high-loss samples is wasted. To this end, we propose a noise-robust approach named Jo-SRC (Joint Sample Selection and Model Regularization based on Consistency). Specifically, we train the network in a contrastive learning manner. Predictions from two different views of each sample are used to estimate its "likelihood" of being clean or out-of-distribution. Furthermore, we propose a joint loss to advance the model generalization performance by introducing consistency regularization. Extensive experiments have validated the superiority of our approach over existing state-of-the-art methods.


title: Learning Fine-Grained Segmentation of 3D Shapes without Part Labels

abstract: Learning-based 3D shape segmentation is usually formulated as a semantic labeling problem, assuming that all parts of training shapes are annotated with a given set of tags. This assumption, however, is impractical for learning fine-grained segmentation. Although most off-the-shelf CAD models are, by construction, composed of fine-grained parts, they usually miss semantic tags and labeling those fine-grained parts is extremely tedious. We approach the problem with deep clustering, where the key idea is to learn part priors from a shape dataset with fine-grained segmentation but no part labels. Given point sampled 3D shapes, we model the clustering priors of points with a similarity matrix and achieve part segmentation through minimizing a novel low rank loss. To handle highly densely sampled point sets, we adopt a divide-and-conquer strategy. We partition the large point set into a number of blocks. Each block is segmented using a deep-clustering-based part prior network trained in a category-agnostic manner. We then train a graph convolution network to merge the segments of all blocks to form the final segmentation result. Our method is evaluated with a challenging benchmark of fine-grained segmentation, showing state-of-the-art performance.


title: Czert -- Czech BERT-like Model for Language Representation

abstract: This paper describes the training process of the first Czech monolingual language representation models based on BERT and ALBERT architectures. We pre-train our models on more than 340K of sentences, which is 50 times more than multilingual models that include Czech data. We outperform the multilingual models on 9 out of 11 datasets. In addition, we establish the new state-of-the-art results on nine datasets. At the end, we discuss properties of monolingual and multilingual models based upon our results. We publish all the pre-trained and fine-tuned models freely for the research community.


title: An Exploration of Geo-temporal Characteristics of Users' Reactions on Social Media During the Pandemic

abstract: During the outbreak of the COVID-19 pandemic, social networks become the preeminent medium for communication, social discussion, and entertainment. Social network users are regularly expressing their opinions about the impacts of the coronavirus pandemic. Therefore, social networks serve as a reliable source for studying the topics, emotions, and attitudes of users that are discussed during the pandemic. In this paper, we investigate the reactions and attitudes of people towards topics raised on social media platforms. We collected data of two large-scale COVID-19 datasets from Twitter and Instagram for six and three months, respectively. The paper analyzes the reaction of social network users on different aspects including sentiment analysis, topics detection, emotions, and geo-temporal characteristics of our dataset. We show that the dominant sentiment reactions on social media are neutral while the most discussed topics by social network users are about health issues. The paper examines the countries that attracted more posts and reactions from people, as well as the distribution of health-related topics discussed in the most mentioned countries. We shed light on the temporal shift of topics over countries. Our results show that posts from the top-mentioned countries influence and attract more reaction worldwide than posts from other parts of the world.


title: Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2

abstract: Thinking aloud is an effective meta-cognitive strategy human reasoners apply to solve difficult problems. We suggest to improve the reasoning ability of pre-trained neural language models in a similar way, namely by expanding a task's context with problem elaborations that are dynamically generated by the language model itself. Our main result is that dynamic problem elaboration significantly improves the zero-shot performance of GPT-2 in a deductive reasoning and natural language inference task: While the model uses a syntactic heuristic for predicting an answer, it is capable (to some degree) of generating reasoned additional context which facilitates the successful application of its heuristic. We explore different ways of generating elaborations, including fewshot learning, and find that their relative performance varies with the specific problem characteristics (such as problem difficulty). Moreover, the effectiveness of an elaboration can be explained in terms of the degree to which the elaboration semantically coheres with the corresponding problem. In particular, elaborations that are most faithful to the original problem description may boost accuracy by up to 24%.


title: Depth resolution of transmission ERDA for H in Al under nuclear-elastically enhanced recoiling of H by 8 MeV He

abstract: This manuscript describes our experimental work being carried out to develop the previously published T-ERDA technique to measure H distribution in solids [Yamazaki et al., AIP Adv. 9 (2019) 105111]. From the experiments for the samples with H markers, we have identified the factors that degrade the depth resolution for analysis of H distribution, depending on the acceptance conditions of the detector.


title: Hidden Zeeman-type spin polarization in bulk crystals

abstract: Exploring hidden effects that have been overlooked given the nominal global crystal symmetry but are indeed visible in solid-state materials has been a fascinating subject of research recently. Here, we introduce a novel hidden Zeeman-type spin polarization (HZSP) in nonmagnetic bulk crystals with sublattice structures. In the momentum space of these crystals, the doubly degenerate bands formed in a certain plane can exhibit a uniform spin configuration with opposite spin orientations perpendicular to this plane, whereas such degenerate states are spatially separated in a pair of real-space sectors. Interestingly, we find that HZSP can manifest itself in both centrosymmetric and non-centrosymmetric materials. We further demonstrate the important role of nonsymmorphic twofold screw-rotational symmetry played in the formation of HZSP. Moreover, two representative material examples, i.e., centrosymmetric WSe$_2$ and noncentrosymmetric BaBi$_4$O$_7$, are identified to show HZSP via first-principles calculations. Our finding thus not only opens new perspectives for hidden spin polarization research but also significantly broadens the range of materials towards spintronics applications.


title: Skyrmion size in skyrmion crystals

abstract: A magnetic skyrmion is a topological object that can exist as a solitary embedded in the vast ferromagnetic phase, or coexists with a group of its "siblings" in various stripy phases as well as skyrmion crystals (SkXs). Isolated skyrmions and skyrmions in an SkX are circular while a skyrmion in other phases is a stripe of various forms. Unexpectedly, the sizes of the three different types of skyrmions depend on material parameters differently. For chiral magnetic films with exchange stiffness constant $A$, the Dzyaloshinskii-Moriya interaction (DMI) strength $D$, and perpendicular magnetic anisotropy $K$, $\kappa\equiv\pi^2D^2/(16AK)=1$ separates isolated skyrmions from condensed skyrmion states. In contrast to isolated skyrmions whose size increases with $D/K$ and is insensitive to $\kappa\ll1$ and stripe skyrmions whose width increases with $A/D$ and is insensitive to $\kappa\gg1$, the size of skyrmions in SkXs is inversely proportional to the square root of skyrmion number density and decreases with $A/D$. This finding has important implications in our search for stable smaller skyrmions at the room temperature in applications.


title: Removal of persistent organic contaminants from wastewater using a hybrid electrochemical-granular activated carbon (GAC) system

abstract: A three-dimensional (3D) electrochemical flow-through reactor equipped with GAC packed bed, polarized by the electric field, was evaluated for the removal of persistent organic contaminants from real sewage effluent. The performance of the reactor was investigated for 27 consecutive runs at two anodic current densities, i.e., low current density (LCD) of 15 A m-2, and high current density (HCD) of 100 A m-2. In the HCD experiments, the adsorption ability of saturated GAC was increased, mainly due to the increase in the mesoporosity of GAC. A synergy between electrosorption/adsorption on GAC and electrooxidation was observed in terms of the removal of all target pollutants. DEET presented the highest synergy, ranging from 40-57%, followed by iopromide (22-46%), carbamazepine (15-34%) and diatrizoate (4-30%). The addition of GAC decreased the concentrations of toxic chlorate and perchlorate by 2-fold and 10-fold, respectively, due to their electrosorption on GAC. Also, 3D electrochemical system yielded lower concentrations of adsorbable organic iodide (AOI) and adsorbable organic chlorine (AOCl). Thus, addition of low amounts of GAC in electrochemical systems may be a low-cost and simple way of minimizing the formation and final effluent concentrations of toxic halogenated byproducts.


title: Spin susceptibilities in magnetic type-I and type-II Weyl semimetals

abstract: We investigate interacting spin susceptibilities in lattice models for $\mathcal{T}$-reversal symmetry-broken Weyl semimetals. We employ a random phase approximation (RPA) method for the spin-SU(2)-symmetry-broken case that includes mixtures of ladder and bubble diagrams, beyond a SU(2)-symmetric case. Within this approach, the relations between the tendency towards magnetic order and the band structure tilt parameter $\gamma$ under different temperatures are explored. The critical interaction strength $U_c$ for magnetic ordering decreases as the tilt term changes from type-I Weyl semimetals to type-II. The lower temperature, the sharper is the drop in $U_c$ at the critical point between them. The variation of $U_c$ with a slight doping near half-filling is also studied. It is generally found that these Weyl systems show a strongly anisotropic spin response with an enhanced doubly degenerate transverse susceptibility perpendicular to tilt direction, inherited from $\mathcal{C}_{4z}$ rational symmetry of bare Hamiltonian, but with the longitudinal response suppressed with respect to that. For small tilts $\gamma$ and strong enough interaction, we find two degenerate ordering patterns with spin order orthogonal to the tilt direction but much shorter spin correlation length parallel to the spin direction. With increasing the tilt, the system develops instabilities with respect to in-plane magnetic orders with wavevector $(0,\pi, q_z)$ and $(\pi,0, q_z)$, with $q_z$ increasing from 0 to $\pi$ before the transition to a type-II Weyl semimetal is reached. These results indicate a greater richness of magnetic phases in correlated Weyl semimetals that also pose challenges for precise theoretical descriptions.


title: Note on the offspring distribution for group testing in the linear regime

abstract: The group testing problem is concerned with identifying a small set of $k$ infected individuals in a large population of $n$ people. At our disposal is a testing scheme that can test groups of individuals. A test comes back positive if and only if at least one individual is infected. In this note, we lay groundwork for analysing belief propagation for group testing when $k$ scales linearly in $n$. To this end, we derive the offspring distribution for different types of individuals. With these distributions at hand, one can employ the population dynamics algorithm to simulate the posterior marginal distribution resulting from belief propagation.


title: Flatness-based MPC for underactuated surface vessels in confined areas

abstract: A two-phase model predictive controller (MPC) is proposed for underactuated surface vessel operation in confined environments. For general driving maneuvers (phase one) the ship's geometry is not considered explicitly while in more restricted areas (stage two) which occur, e.g., in mooring maneuvers, the ship's geometry is approximated to ensure collision avoidance. To remove the dynamical constraint in the problem setup, the differential flatness of the fully actuated system is exploited and the flat outputs are parameterized using B-spline functions. Underactuated behavior is retained by means of inequality constraints that are imposed on the non-controllable input. In an effort to solve the MPC, a static nonlinear optimization problem is formulated and feasibility w.r.t. obstacles and actuator constraints is ensured at collocation points. Static obstacles are considered as constructive solid geometry functions in the MPC which also takes into account disturbances induced by wind.


title: Coarse-to-Fine Domain Adaptive Semantic Segmentation with Photometric Alignment and Category-Center Regularization

abstract: Unsupervised domain adaptation (UDA) in semantic segmentation is a fundamental yet promising task relieving the need for laborious annotation works. However, the domain shifts/discrepancies problem in this task compromise the final segmentation performance. Based on our observation, the main causes of the domain shifts are differences in imaging conditions, called image-level domain shifts, and differences in object category configurations called category-level domain shifts. In this paper, we propose a novel UDA pipeline that unifies image-level alignment and category-level feature distribution regularization in a coarse-to-fine manner. Specifically, on the coarse side, we propose a photometric alignment module that aligns an image in the source domain with a reference image from the target domain using a set of image-level operators; on the fine side, we propose a category-oriented triplet loss that imposes a soft constraint to regularize category centers in the source domain and a self-supervised consistency regularization method in the target domain. Experimental results show that our proposed pipeline improves the generalization capability of the final segmentation model and significantly outperforms all previous state-of-the-arts.


title: Accelerating Sparse Approximate Matrix Multiplication on GPUs

abstract: Although the matrix multiplication plays a vital role in computational linear algebra, there are few efficient solutions for matrix multiplication of the near-sparse matrices. The Sparse Approximate Matrix Multiply (SpAMM) is one of the algorithms to fill the performance gap neglected by traditional optimizations for dense/sparse matrix multiplication. However, existing SpAMM algorithms fail to exploit the performance potential of GPUs for acceleration. In this paper, we present cuSpAMM, the first parallel SpAMM algorithm optimized for multiple GPUs. Several performance optimizations have been proposed, including algorithm re-design to adapt to the thread parallelism, blocking strategies for memory access optimization, and the acceleration with the tensor core. In addition, we scale cuSpAMM to run on multiple GPUs with an effective load balance scheme. We evaluate cuSpAMM on both synthesized and real-world datasets on multiple GPUs. The experiment results show that cuSpAMM achieves significant performance speedup compared to vendor optimized cuBLAS and cuSPARSE libraries.


title: Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

abstract: In this paper, a novel convolutional neural network (CNN)-based framework is developed for light field reconstruction from a sparse set of views. We indicate that the reconstruction can be efficiently modeled as angular restoration on an epipolar plane image (EPI). The main problem in direct reconstruction on the EPI involves an information asymmetry between the spatial and angular dimensions, where the detailed portion in the angular dimensions is damaged by undersampling. Directly upsampling or super-resolving the light field in the angular dimensions causes ghosting effects. To suppress these ghosting effects, we contribute a novel "blur-restoration-deblur" framework. First, the "blur" step is applied to extract the low-frequency components of the light field in the spatial dimensions by convolving each EPI slice with a selected blur kernel. Then, the "restoration" step is implemented by a CNN, which is trained to restore the angular details of the EPI. Finally, we use a non-blind "deblur" operation to recover the spatial high frequencies suppressed by the EPI blur. We evaluate our approach on several datasets, including synthetic scenes, real-world scenes and challenging microscope light field data. We demonstrate the high performance and robustness of the proposed framework compared with state-of-the-art algorithms. We further show extended applications, including depth enhancement and interpolation for unstructured input. More importantly, a novel rendering approach is presented by combining the proposed framework and depth information to handle large disparities.