title: Parkinsonian Chinese Speech Analysis towards Automatic Classification of Parkinson's Disease

abstract: Speech disorders often occur at the early stage of Parkinson's disease (PD). The speech impairments could be indicators of the disorder for early diagnosis, while motor symptoms are not obvious. In this study, we constructed a new speech corpus of Mandarin Chinese and addressed classification of patients with PD. We implemented classical machine learning methods with ranking algorithms for feature selection, convolutional and recurrent deep networks, and an end to end system. Our classification accuracy significantly surpassed state-of-the-art studies. The result suggests that free talk has stronger classification power than standard speech tasks, which could help the design of future speech tasks for efficient early diagnosis of the disease. Based on existing classification methods and our natural speech study, the automatic detection of PD from daily conversation could be accessible to the majority of the clinical population.


title: The equivalence of the Delta method and the cluster-robust variance estimator for the analysis of clustered randomized experiments

abstract: It often happens that the same problem presents itself to different communities and the solutions proposed or adopted by those communities are different. We take the case of the variance estimation of the population average treatment effect in cluster-randomized experiments. The econometrics literature promotes the cluster-robust variance estimator (Athey and Imbens, 2017), which can be dated back to the study of linear regression with clustered residuals (Liang and Zeger, 1986). The A/B testing or online experimentation literature promotes the delta method (Kohavi et al., 2010, Deng et al., 2017, 2018), which tackles the variance estimation of the ATE estimator directly using large sample theory. The two methods are seemly different as the former begins with a regression setting at the individual unit level and the latter is semi-parametric with only i.i.d. assumptions on the clusters. Both methods are widely used in practice. It begs the question for their connection and comparison. In this paper we prove they are equivalent and in the canonical implementation they should give exactly the same result.


title: The Role of Entropy in Guiding a Connection Prover

abstract: In this work we study how to learn good algorithms for selecting reasoning steps in theorem proving. We explore this in the connection tableau calculus implemented by leanCoP where the partial tableau provides a clean and compact notion of a state to which a limited number of inferences can be applied. We start by incorporating a state-of-the-art learning algorithm -- a graph neural network (GNN) -- into the plCoP theorem prover. Then we use it to observe the system's behaviour in a reinforcement learning setting, i.e., when learning inference guidance from successful Monte-Carlo tree searches on many problems. Despite its better pattern matching capability, the GNN initially performs worse than a simpler previously used learning algorithm. We observe that the simpler algorithm is less confident, i.e., its recommendations have higher entropy. This leads us to explore how the entropy of the inference selection implemented via the neural network influences the proof search. This is related to research in human decision-making under uncertainty, and in particular the probability matching theory. Our main result shows that a proper entropy regularisation, i.e., training the GNN not to be overconfident, greatly improves plCoP's performance on a large mathematical corpus.


title: Emergence and algorithmic information dynamics of systems and observers

abstract: Previous work has shown that perturbation analysis in software space can produce candidate computable generative models and uncover possible causal properties from the finite description of an object or system quantifying the algorithmic contribution of each of its elements relative to the whole. One of the challenges for defining emergence is that one observer's prior knowledge may cause a phenomenon to present itself to such observer as emergent while for another as reducible. By formalising the act of observing as mutual perturbations between dynamical systems, we demonstrate that emergence of algorithmic information do depend on the observer's formal knowledge, while robust to other subjective factors, particularly: the choice of the programming language and the measurement method; errors or distortions during the information acquisition; and the informational cost of processing. This is called observer-dependent emergence (ODE). In addition, we demonstrate that the unbounded and fast increase of emergent algorithmic information implies asymptotically observer-independent emergence (AOIE). Unlike ODE, AOIE is a type of emergence for which emergent phenomena will remain considered to be emergent for every formal theory that any observer might devise. We demonstrate the existence of an evolutionary model that displays the diachronic variant of AOIE and a network model that displays the holistic variant of AOIE. Our results show that, restricted to the context of finite discrete deterministic dynamical systems, computable systems, and irreducible information content measures, AOIE is the strongest form of emergence that formal theories can attain.

categories: cs.IT cs.FL cs.MA cs.SY eess.SY math.DS math.IT


title: Blockchain Assisted Federated Learning over Wireless Channels: Dynamic Resource Allocation and Client Scheduling

abstract: The blockchain technology has been extensively studied to enable distributed and tamper-proof data processing in federated learning (FL). Most existing blockchain assisted FL (BFL) frameworks have employed a third-party blockchain network to decentralize the model aggregation process. However, decentralized model aggregation is vulnerable to pooling and collusion attacks from the third-party blockchain network. Driven by this issue, we propose a novel BFL framework that features the integration of training and mining at the client side. To optimize the learning performance of FL, we propose to maximize the long-term time average (LTA) training data size under a constraint of LTA energy consumption. To this end, we formulate a joint optimization problem of training client selection and resource allocation (i.e., the transmit power and computation frequency at the client side), and solve the long-term mixed integer non-linear programming based on a Lyapunov technique. In particular, the proposed dynamic resource allocation and client scheduling (DRACS) algorithm can achieve a trade-off of [$\mathcal{O}(1/V)$, $\mathcal{O}(\sqrt{V})$] to balance the maximization of the LTA training data size and the minimization of the LTA energy consumption with a control parameter $V$. Our experimental results show that the proposed DRACS algorithm achieves better learning accuracy than benchmark client scheduling strategies with limited time or energy consumption.


title: Joint Stabilization and Regret Minimization through Switching in Over-Actuated Systems (extended version)

abstract: Adaptively controlling and minimizing regret in unknown dynamical systems while controlling the growth of the system state is crucial in real-world applications. In this work, we study the problem of stabilization and regret minimization of linear over-actuated dynamical systems. We propose an optimism-based algorithm that leverages possibility of switching between actuating modes in order to alleviate state explosion during initial time steps. We theoretically study the rate at which our algorithm learns a stabilizing controller and prove that it achieves a regret upper bound of $\mathcal{O}(\sqrt{T})$.


title: Robustifying $\ell_\infty$ Adversarial Training to the Union of Perturbation Models

abstract: Classical adversarial training (AT) frameworks are designed to achieve high adversarial accuracy against a single attack type, typically $\ell_\infty$ norm-bounded perturbations. Recent extensions in AT have focused on defending against the union of multiple perturbations but this benefit is obtained at the expense of a significant (up to $10\times$) increase in training complexity over single-attack $\ell_\infty$ AT. In this work, we expand the capabilities of widely popular single-attack $\ell_\infty$ AT frameworks to provide robustness to the union of ($\ell_\infty, \ell_2, \ell_1$) perturbations while preserving their training efficiency. Our technique, referred to as Shaped Noise Augmented Processing (SNAP), exploits a well-established byproduct of single-attack AT frameworks -- the reduction in the curvature of the decision boundary of networks. SNAP prepends a given deep net with a shaped noise augmentation layer whose distribution is learned along with network parameters using any standard single-attack AT. As a result, SNAP enhances adversarial accuracy of ResNet-18 on CIFAR-10 against the union of ($\ell_\infty, \ell_2, \ell_1$) perturbations by 14%-to-20% for four state-of-the-art (SOTA) single-attack $\ell_\infty$ AT frameworks, and, for the first time, establishes a benchmark for ResNet-50 and ResNet-101 on ImageNet.


title: CTSpine1K: A Large-Scale Dataset for Spinal Vertebrae Segmentation in Computed Tomography

abstract: Spine-related diseases have high morbidity and cause a huge burden of social cost. Spine imaging is an essential tool for noninvasively visualizing and assessing spinal pathology. Segmenting vertebrae in computed tomography (CT) images is the basis of quantitative medical image analysis for clinical diagnosis and surgery planning of spine diseases. Current publicly available annotated datasets on spinal vertebrae are small in size. Due to the lack of a large-scale annotated spine image dataset, the mainstream deep learning-based segmentation methods, which are data-driven, are heavily restricted. In this paper, we introduce a large-scale spine CT dataset, called CTSpine1K, curated from multiple sources for vertebra segmentation, which contains 1,005 CT volumes with over 11,100 labeled vertebrae belonging to different spinal conditions. Based on this dataset, we conduct several spinal vertebrae segmentation experiments to set the first benchmark. We believe that this large-scale dataset will facilitate further research in many spine-related image analysis tasks, including but not limited to vertebrae segmentation, labeling, 3D spine reconstruction from biplanar radiographs, image super-resolution, and enhancement.


title: Can a pure state remain pure in the Unruh effect?

abstract: A uniformly accelerated detector in an inertial vacuum undergoes an unavoidable dissipation, and the final steady-state becomes thermal. However, to attain such a mixed state, there is no bound for the acceleration of the single atomic detector. Here we show that the scenario is entirely different for two atoms with the same energy levels. There exists a critical limit of the acceleration for two atomic detectors, below which the purity of a particular initial state can be preserved. We observe that the generator of the dissipative dynamics (Lindbladian) is invariant under a weak symmetry transformation at this limit. Hence one of the eigenstates of the symmetry operator is unchanged during the evolution. This kind of state is called a quantum dark state, which is essentially a decoherence-free subspace. As a consequence, the system becomes localized, and it can skip the Unruh thermalization. Beyond the critical limit, the symmetry is explicitly broken. Therefore our results suggest that the system goes through a first-order dissipative phase transition from a localized to a thermal phase.


title: 1xN Pattern for Pruning Convolutional Neural Networks

abstract: Though network pruning receives popularity in reducing the complexity of convolutional neural networks (CNNs), it remains an open issue to concurrently maintain model accuracy as well as achieve significant speedups on general CPUs. In this paper, we propose a novel 1xN pruning pattern to break this limitation. In particular, consecutive N output kernels with the same input channel index are grouped into one block, which serves as a basic pruning granularity of our pruning pattern. Our 1xN pattern prunes these blocks considered unimportant. We also provide a workflow of filter rearrangement that first rearranges the weight matrix in the output channel dimension to derive more influential blocks for accuracy improvements and then applies similar rearrangement to the next-layer weights in the input channel dimension to ensure correct convolutional operations. Moreover, the output computation after our 1xN pruning can be realized via a parallelized block-wise vectorized operation, leading to significant speedups on general CPUs. The efficacy of our pruning pattern is proved with experiments on ILSVRC-2012. For example, given the pruning rate of 50% and N=4, our pattern obtains about 3.0% improvements over filter pruning in the top-1 accuracy of MobileNet-V2. Meanwhile, it obtains 56.04ms inference savings on Cortex-A7 CPU over weight pruning. Our project is made available at https://github.com/lmbxmu/1xN.


title: Parameterized combinatorial curvatures and parameterized combinatorial curvature flows for discrete conformal structures on polyhedral surfaces

abstract: Discrete conformal structure on polyhedral surfaces is a discrete analogue of the smooth conformal structure on surfaces that assigns discrete metrics by scalar functions defined on vertices. In this paper, we introduce combinatorial $\alpha$-curvature for discrete conformal structures on polyhedral surfaces, which is a parameterized generalization of the classical combinatorial curvature. Then we prove the local and global rigidity of combinatorial $\alpha$-curvature with respect to discrete conformal structures on polyhedral surfaces, which confirms parameterized Glickenstein rigidity conjecture. To study the Yamabe problem for combinatorial $\alpha$-curvature, we introduce combinatorial $\alpha$-Ricci flow for discrete conformal structures on polyhedral surfaces, which is a generalization of Chow-Luo's combinatorial Ricci flow for Thurston's circle packings and Luo's combinatorial Yamabe flow for vertex scaling on polyhedral surfaces. To handle the potential singularities of the combinatorial $\alpha$-Ricci flow, we extend the flow through the singularities by extending the inner angles in triangles by constants. Under the existence of a discrete conformal structure with prescribed combinatorial curvature, the solution of extended combinatorial $\alpha$-Ricci flow is proved to exist for all time and converge exponentially fast for any initial value. This confirms a parameterized generalization of another conjecture of Glickenstein on the convergence of combinatorial Ricci flow, gives an almost equivalent characterization of the solvability of Yamabe problem for combinatorial $\alpha$-curvature in terms of combinatorial $\alpha$-Ricci flow and provides an effective algorithm for finding discrete conformal structures with prescribed combinatorial $\alpha$-curvatures.


title: On the conditions of the solvability of boundary value problems for a single high-order equation with variable coefficients

abstract: A Dirichlet-type problem is studied for an equation of even order with variable coefficients. A criterion for the uniqueness of a solution is given. The solution is built in the form of a Fourier series. When justifying the convergence of the series, the problem of small denominators arises. Sufficient conditions for the separability of the denominator from zero are obtained. It is shown that the solvability of the problem is influenced not only by the dimension of the rectangle, but also by the orders of the specified derivatives at the lower boundary of the rectangle.


title: Improving the Accuracy and Efficiency of Online Calibration for Simulation-based Dynamic Traffic Assignment

abstract: Simulation-based Dynamic Traffic Assignment models have important applications in real-time traffic management and control. The efficacy of these systems rests on the ability to generate accurate estimates and predictions of traffic states, which necessitates online calibration. A widely used solution approach for online calibration is the Extended Kalman Filter (EKF), which -- although appealing in its flexibility to incorporate any class of parameters and measurements -- poses several challenges with regard to calibration accuracy and scalability, especially in congested situations for large-scale networks. This paper addresses these issues in turn so as to improve the accuracy and efficiency of EKF-based online calibration approaches for large and congested networks. First, the concept of state augmentation is revisited to handle violations of the Markovian assumption typically implicit in online applications of the EKF. Second, a method based on graph-coloring is proposed to operationalize the partitioned finite-difference approach that enhances scalability of the gradient computations. Several synthetic experiments and a real world case study demonstrate that application of the proposed approaches yields improvements in terms of both prediction accuracy and computational performance. The work has applications in real-world deployments of simulation-based dynamic traffic assignment systems.


title: Multi-Scale Temporal Convolution Network for Classroom Voice Detection

abstract: Teaching with the cooperation of expert teacher and assistant teacher, which is the so-called "double-teachers classroom", i.e., the course is giving by the expert online and presented through projection screen at the classroom, and the teacher at the classroom performs as an assistant for guiding the students in learning, is becoming more prevalent in today's teaching method for K-12 education. For monitoring the teaching quality, a microphone clipped on the assistant's neckline is always used for voice recording, then fed to the downstream tasks of automatic speech recognition (ASR) and neural language processing (NLP). However, besides its voice, there would be some other interfering voices, including the expert's one and the student's one. Here, we propose to extract the assistant' voices from the perspective of sound event detection, i.e., the voices are classified into four categories, namely the expert, the teacher, the mixture of them, and the background. To make frame-level identification, which is important for grabbing sensitive words for the downstream tasks, a multi-scale temporal convolution neural network is constructed with stacked dilated convolutions for considering both local and global properties. These features are concatenated and fed to a classification network constructed by three linear layers. The framework is evaluated on simulated data and real-world recordings, giving considerable performance in terms of precision and recall, compared with some classical classification methods.


title: Numerical study on the deadline-concerning priority queuing model

abstract: The Barab\'asi's priority queuing model [A.-L. Barab\'asi, Nature \textbf{435}, 207 (2005)] and its variants have been extensively studied to understand heavy-tailed distributions of the inter-event times and the response times observed in various empirical analyses of human dynamics. In this paper, we focus on the effects of deadlines assigned to the tasks in a queue of fixed size on the response-time distributions. Here, the response time is defined as the time interval between the arrival and the execution of the task. We propose a deadline-concerning priority queuing model, in which as the deadline approaches, the priority is adjusted using the inverse of the remaining time to the deadline. By performing the numerical simulations, we find that the power-law exponent characterizing the response-time distributions is less than $1$ under the deterministic selection protocol while it has the value of $1$ under the nondeterministic selection protocol.


title: Noise Classification Aided Attention-Based Neural Network for Monaural Speech Enhancement

abstract: This paper proposes an noise type classification aided attention-based neural network approach for monaural speech enhancement. The network is constructed based on a previous work by introducing a noise classification subnetwork into the structure and taking the classification embedding into the attention mechanism for guiding the network to make better feature extraction. Specifically, to make the network an end-to-end way, an audio encoder and decoder constructed by temporal convolution is used to make transformation between waveform and spectrogram. Additionally, our model is composed of two long short term memory (LSTM) based encoders, two attention mechanism, a noise classifier and a speech mask generator. Experiments show that, compared with OM-LSA and the previous work, the proposed noise classification aided attention-based approach can achieve better performance in terms of speech quality (PESQ). More promisingly, our approach has better generalization ability to unseen noise conditions.


title: Energy-preserving fully-discrete schemes for nonlinear stochastic wave equations with multiplicative noise

abstract: In this paper, we focus on constructing numerical schemes preserving the averaged energy evolution law for nonlinear stochastic wave equations driven by multiplicative noise. We first apply the compact finite difference method and the interior penalty discontinuous Galerkin finite element method to discretize space variable and present two semi-discrete schemes, respectively. Then we make use of the discrete gradient method and the Pad\'e approximation to propose efficient fully-discrete schemes. These semi-discrete and fully-discrete schemes are proved to preserve the discrete averaged energy evolution law. In particular, we also prove that the proposed fully-discrete schemes exactly inherit the averaged energy evolution law almost surely if the considered model is driven by additive noise. Numerical experiments are given to confirm theoretical findings.


title: Theoretical development in the viscosity of ferrofluid

abstract: The viscosity of ferrofluid has an important role in liquid sealing of the hard disk drives, biomedical applications as drug delivery, hyperthermia, and magnetic resonance imaging. In the absence of a magnetic field, the viscosity of ferrofluid depends on the volume concentration of magnetic nanoparticles including surfactant layers. However, under the influence of a stationary magnetic field, the viscosity of ferrofluid depends on the angle between the applied magnetic field and vorticity in the flow. If this angle is 90o, then there is a maximum increase in the viscosity. If the magnetic field and the vorticity in the flow are parallel to each other, then there is no change in the viscosity since the applied magnetic field does not change the speed of the rotation of magnetic nanoparticles in the fluid. The viscosity of ferrofluid in the presence of an alternating magnetic field demonstrates interesting behavior. When field frequency matches with the relaxation time, known as resonance condition, then there is no impact of an alternating magnetic field in the viscosity of ferrofluid. If the frequency of an alternating magnetic field is less than resonance frequency, then an alternating magnetic field increases the viscosity of ferrofluid. Using higher frequency than resonance condition reduces the viscosity of ferrofluid and researchers reported this incident as the negative viscosity effect. If the frequency of an alternating magnetic field tends to infinite, then ferrofluid ceases to feel a magnetic field. In this case, there is no impact of an alternating magnetic field on the viscosity of ferrofluid.


title: Algebraic constructions for Jacobi-Jordan algebras

abstract: For a given Jacobi-Jordan algebra $A$ and a vector space $V$ over a field $k$, a non-abelian cohomological type object ${\mathcal H}^{2}_{A} \, (V, \, A)$ is constructed: it classifies all Jacobi-Jordan algebras containing $A$ as a subalgebra of codimension equal to ${\rm dim}_k (V)$. Any such algebra is isomorphic to a so-called \emph{unified product} $A \, \natural \, V$. Furthermore, we introduce the bicrossed (semi-direct, crossed, or skew crossed) product $A \bowtie V$ associated to two Jacobi-Jordan algebras as a special case of the unified product. Several examples and applications are provided: the Galois group of the extension $A \subseteq A \bowtie V$ is described as a subgroup of the semidirect product of groups ${\rm GL}_k (V) \rtimes {\rm Hom}_k (V, \, A)$ and an Artin type theorem for Jacobi-Jordan algebra is proven. The key tools for classifying supersolvable and flag Jacobi-Jordan algebras are introduced.


title: Search for doubly-heavy dibaryons in the quark-delocalization color-screening model

abstract: We perform a systemical investigation of the low-lying doubly-heavy dibaryon systems with strange $S=0$, isospin $I=0$, $1$, $2$ and the angular momentum $J=0$, $1$, $2$, $3$ in the quark delocalization color screening model. We find the effect of channel-coupling cannot be neglected in the study of the multi-quark systems. Due to the heavy flavor symmetry, the results of the doubly-charm and doubly-bottom dibaryon systems are similar with each other. Both of them have three bound states, the quantum numbers of which are $IJ=00$, $IJ=02$ and $IJ=13$, respectively. The energies are $4554$ MeV, $4741$ MeV, and $4969$ MeV respectively for the doubly-charm systems and $11219$ MeV, $11416$ MeV, and $11633$ MeV respectively for the doubly-bottom dibaryon systems. Besides, six resonance states are obtained, which are $IJ=00$ $N\Xi_{cc}$ and $N\Xi_{bb}$ with resonance mass of $4716$ MeV and $11411$ MeV respectively, $IJ=11$ $N\Xi^*_{cc}$ and $N\Xi^*_{bb}$ with resonance mass of $4757$ MeV and $11432$ MeV respectively, and $IJ=12$ $\Sigma_{c}\Sigma^*_{c}$ and $\Sigma_{b}\Sigma^*_{b}$ with resonance mass of $4949$ MeV and $11626$ MeV respectively. All these heavy dibaryons are worth searching for on experiments, although it will be a challenging work.


title: Mobility edges in $\mathcal{PT}$-symmetric cross-stitch flat band lattices

abstract: We study the cross-stitch flat band lattice with a $\mathcal{PT}$-symmetric on-site potential and uncover mobility edges with exact solutions. Furthermore, we study the relationship between the $\mathcal{PT}$ symmetry broken point and the localization-delocalization transition point, and verify that mobility edges in this non-Hermitian model is available to signal the $\mathcal{PT}$ symmetry breaking.


title: Understanding creep of a single-crystalline Co-Al-W-Ta superalloy by studying the deformation mechanism, segregation tendency and stacking fault energy

abstract: A systematic study of the compression creep properties of a single-crystalline Co-base superalloy (Co-9Al-7.5W-2Ta) was conducted at 950 {\deg}C, 975 {\deg}C and 1000 {\deg}C to reveal the influence of temperature and the resulting diffusion velocity of solutes like Al, W and Ta on the deformation mechanisms. Two creep rate minima are observed at all temperatures indicating that the deformation mechanisms causing these minima are quite similar. Atom-probe tomography analysis reveals elemental segregation to stacking faults, which had formed in the $\gamma\prime$ phase during creep. Density-functional-theory calculations indicate segregation of W and Ta to the stacking fault and an associated considerable reduction of the stacking fault energy. Since solutes diffuse faster at a higher temperature, segregation can take place more quickly. This results in a significantly faster softening of the alloy, since cutting of the $\gamma\prime$ precipitate phase by partial dislocations is facilitated through segregation already during the early stages of creep. This is confirmed by transmission electron microscopy analysis. Therefore, not only the smaller precipitate fraction at higher temperatures is responsible for the worse creep properties, but also faster diffusion-assisted shearing of the $\gamma\prime$ phase by partial dislocations. The understanding of these mechanisms will help in future alloy development by offering new design criteria.


title: BourbOulipo. Relazioni tra Oulipo e Bourbaki

abstract: The theme of the influence of Bourbaki's ideas and methodologies on disciplines that transcend the mathematical field has been frequently addressed and, in particular, the reflection on the relationship between Bourbaki and Oulipo has animated a passionate debate within literary criticism. The purpose of this contribution is to investigate the relations between Le Lionnais, Queneau and Roubaud - and more generally Oulipo - and Bourbaki. Through a comparative examination between the two groups, the existence of an undeniable charisma of the "polycephalic mathematician" on the artistic-literary movement was highlighted.


title: Transferable Sparse Adversarial Attack

abstract: Deep neural networks have shown their vulnerability to adversarial attacks. In this paper, we focus on sparse adversarial attack based on the $\ell_0$ norm constraint, which can succeed by only modifying a few pixels of an image. Despite a high attack success rate, prior sparse attack methods achieve a low transferability under the black-box protocol due to overfitting the target model. Therefore, we introduce a generator architecture to alleviate the overfitting issue and thus efficiently craft transferable sparse adversarial examples. Specifically, the generator decouples the sparse perturbation into amplitude and position components. We carefully design a random quantization operator to optimize these two components jointly in an end-to-end way. The experiment shows that our method has improved the transferability by a large margin under a similar sparsity setting compared with state-of-the-art methods. Moreover, our method achieves superior inference speed, 700$\times$ faster than other optimization-based methods. The code is available at https://github.com/shaguopohuaizhe/TSAA.


title: Geophysical fluid models with simple energy backscatter: explicit flows and unbounded exponential growth

abstract: Motivated by numerical schemes for large scale geophysical flow, we consider the rotating shallow water and Boussinesq equations on the whole space with horizontal kinetic energy backscatter source terms built from negative viscosity and stabilising hyperviscosity with constant parameters. We study the impact of this energy input through various explicit flows, which are simultaneously solving the nonlinear equations and the linear equations that arise upon dropping the transport nonlinearity, i.e. the linearisation in the zero state. These include barotropic, parallel and Kolmogorov flows as well as monochromatic inertia gravity waves. With focus on stable stratification we find that the backscatter generates numerous solutions of this type that grow exponentially and unboundedly, also with vertical structure. This signifies the possibility of undesired energy concentration into specific modes due to the backscatter. Families of steady state flows of this type arise as well and superposition principles in the nonlinear equations provide explicit sufficient conditions for instability of some of these. For certain steady barotropic flows of this type we provide numerical evidence of eigenmodes whose growth rates are proportional to the amplitude factor of the flow. For all other arising steady solutions we prove this is not possible.


title: Strong coupling expansion of free energy and BPS Wilson loop in $\mathcal N=2$ superconformal models with fundamental hypermultiplets

abstract: As a continuation of the study (in arXiv:2102.07696 and arXiv:2104.12625) of strong-coupling expansion of non-planar corrections in $\mathcal N=2$ 4d superconformal models we consider two special theories with gauge groups $SU(N)$ and $Sp(2N)$. They contain $N$-independent numbers of hypermultiplets in rank 2 antisymmetric and fundamental representations and are planar-equivalent to the corresponding $\mathcal N=4$ SYM theories. These $\mathcal N=2$ theories can be realised on a system of $N$ D3-branes with a finite number of D7-branes and O7-plane; the dual string theories should be particular orientifolds of $AdS_5\times S^5$ superstring. Starting with the localization matrix model representation for the $\mathcal N=2$ partition function on $S^4$ we find exact differential relations between the $1/N$ terms in the corresponding free energy $F$ and the $\frac{1}{2}$-BPS Wilson loop expectation value $\langle\mathcal W\rangle$ and also compute their large 't Hooft coupling ($\lambda \gg 1$) expansions. The structure of these expansions is different from the previously studied models without fundamental hypermultiplets. In the more tractable $Sp(2N)$ case we find an exact resummed expression for the leading strong coupling terms at each order in the $1/N$ expansion. We also determine the exponentially suppressed at large $\lambda$ contributions to the non-planar corrections to $F$ and $\langle\mathcal W\rangle$ and comment on their resurgence properties. We discuss dual string theory interpretation of these strong coupling expansions.


title: Transfer Learning as an Enhancement for Reconfiguration Management of Cyber-Physical Production Systems

abstract: Reconfiguration demand is increasing due to frequent requirement changes for manufacturing systems. Recent approaches aim at investigating feasible configuration alternatives from which they select the optimal one. This relies on processes whose behavior is not reliant on e.g. the production sequence. However, when machine learning is used, components' behavior depends on the process' specifics, requiring additional concepts to successfully conduct reconfiguration management. Therefore, we propose the enhancement of the comprehensive reconfiguration management with transfer learning. This provides the ability to assess the machine learning dependent behavior of the different CPPS configurations with reduced effort and further assists the recommissioning of the chosen one. A real cyber-physical production system from the discrete manufacturing domain is utilized to demonstrate the aforementioned proposal.


title: Deep Reinforcement Based Optimization of Function Splitting in Virtualized Radio Access Networks

abstract: Virtualized Radio Access Network (vRAN) is one of the key enablers of future wireless networks as it brings the agility to the radio access network (RAN) architecture and offers degrees of design freedom. Yet, it also creates a challenging problem on how to design the functional split configuration. In this paper, a deep reinforcement learning approach is proposed to optimize function splitting in vRAN. A learning paradigm is developed that optimizes the location of functions in the RAN. These functions can be placed either at a central/cloud unit (CU) or a distributed unit (DU). This problem is formulated as constrained neural combinatorial reinforcement learning to minimize the total network cost. In this solution, a policy gradient method with Lagrangian relaxation is applied that uses a stacked long short-term memory (LSTM) neural network architecture to approximate the policy. Then, a sampling technique with a temperature hyperparameter is applied for the inference process. The results show that our proposed solution can learn the optimal function split decision and solve the problem with a $0.4\%$ optimality gap. Moreover, our method can reduce the cost by up to $320\%$ compared to a distributed-RAN (D-RAN). We also conclude that altering the traffic load and routing cost does not significantly degrade the optimality performance.


title: Hierarchical Deep Network with Uncertainty-aware Semi-supervised Learning for Vessel Segmentation

abstract: The analysis of organ vessels is essential for computer-aided diagnosis and surgical planning. But it is not a easy task since the fine-detailed connected regions of organ vessel bring a lot of ambiguity in vessel segmentation and sub-type recognition, especially for the low-contrast capillary regions. Furthermore, recent two-staged approaches would accumulate and even amplify these inaccuracies from the first-stage whole vessel segmentation into the second-stage sub-type vessel pixel-wise classification. Moreover, the scarcity of manual annotation in organ vessels poses another challenge. In this paper, to address the above issues, we propose a hierarchical deep network where an attention mechanism localizes the low-contrast capillary regions guided by the whole vessels, and enhance the spatial activation in those areas for the sub-type vessels. In addition, we propose an uncertainty-aware semi-supervised training framework to alleviate the annotation-hungry limitation of deep models. The proposed method achieves the state-of-the-art performance in the benchmarks of both retinal artery/vein segmentation in fundus images and liver portal/hepatic vessel segmentation in CT images.


title: Topological frequency shift of quantum oscillation in CaFeAsF

abstract: Guo, Alexandradinata, \textit{et al.} have recently proposed that quantum-oscillation frequencies from Dirac/Weyl fermions exhibit a negative shift proportional to $T^2$ because of the energy dependence of the effective mass peculiar to a linear band-dispersion. We have measured Shubnikov--de Haas oscillation in CaFeAsF up to $T$ = 9 K. The frequency of the $\alpha$ Dirac electron exhibits a negative shift with increasing $T$, while that of the $\beta$ Schr\"odinger hole does not. For $T \geqslant 5$ K where $\beta$ is negligible, the $\alpha$-frequency shift is proportional to $T^2$ and its rate agrees with the theoretical prediction within experimental accuracy. At lower temperatures, the shifts of $\alpha$ and $\beta$ deviate from theoretical expectations, which we ascribe to the inaccuracy in the frequency determination due to unfavorable interference between frequencies. Our results confirm that the topological frequency shift can be utilized to identify Dirac/Weyl fermions when quantum-oscillation frequencies can be determined accurately.


title: Dual-stream Network for Visual Recognition

abstract: Transformers with remarkable global representation capacities achieve competitive results for visual tasks, but fail to consider high-level local pattern information in input images. In this paper, we present a generic Dual-stream Network (DS-Net) to fully explore the representation capacity of local and global pattern features for image classification. Our DS-Net can simultaneously calculate fine-grained and integrated features and efficiently fuse them. Specifically, we propose an Intra-scale Propagation module to process two different resolutions in each block and an Inter-Scale Alignment module to perform information interaction across features at dual scales. Besides, we also design a Dual-stream FPN (DS-FPN) to further enhance contextual information for downstream dense predictions. Without bells and whistles, the proposed DS-Net outperforms DeiT-Small by 2.4% in terms of top-1 accuracy on ImageNet-1k and achieves state-of-the-art performance over other Vision Transformers and ResNets. For object detection and instance segmentation, DS-Net-Small respectively outperforms ResNet-50 by 6.4% and 5.5% in terms of mAP on MSCOCO 2017, and surpasses the previous state-of-the-art scheme, which significantly demonstrates its potential to be a general backbone in vision tasks. The code will be released soon.


title: Entanglement dynamics for Unruh-DeWitt detectors interacting with massive scalar fields: The Unruh and anti-Unruh effects

abstract: We study, in the framework of open quantum systems, the entanglement dynamics for a quantum system composed of two uniformly accelerated Unruh-Dewitt detectors interacting with a bath of massive scalar fields in the Minkowski vacuum. We find that the entanglement evolution for the quantum system coupled with massive fields is always slower compared with that of the one coupled with massless fields, and this time-delay effect brought by the field being massive can however be counteracted by a large enough acceleration, in contrast to the case of a static quantum system in a thermal bath, where this time delay is not affected by the temperature. Remarkably, the maximal concurrence of the quantum system generated during evolution may increase with acceleration for any inter-detector separation while that for static ones in a thermal bath decreases monotonically with temperature, and this can be considered as an anti-Unruh effect in terms of the entanglement generated.


title: Recovering the Potential and Order in One-Dimensional Time-Fractional Diffusion with Unknown Initial Condition and Source

abstract: This paper is concerned with an inverse problem of recovering a potential term and fractional order in a one-dimensional subdiffusion problem, which involves a Djrbashian-Caputo fractional derivative of order $\alpha\in(0,1)$ in time, from the lateral Cauchy data. In the model, we do not assume a full knowledge of the initial data and the source term, since they might be unavailable in some practical applications. We prove the unique recovery of the spatially-dependent potential coefficient and the order $\alpha$ of the derivation simultaneously from the measured trace data at one end point, when the model is equipped with a boundary excitation with a compact support away from $t=0$. One of the initial data and the source can also be uniquely determined, provided that the other is known. The analysis employs a representation of the solution and the time analyticity of the associated function. Further, we discuss a two-stage procedure, directly inspired by the analysis, for the numerical identification of the order and potential coefficient, and illustrate the feasibility of the recovery with several numerical experiments.


title: Semi-orthogonal Embedding for Efficient Unsupervised Anomaly Segmentation

abstract: We present the efficiency of semi-orthogonal embedding for unsupervised anomaly segmentation. The multi-scale features from pre-trained CNNs are recently used for the localized Mahalanobis distances with significant performance. However, the increased feature size is problematic to scale up to the bigger CNNs, since it requires the batch-inverse of multi-dimensional covariance tensor. Here, we generalize an ad-hoc method, random feature selection, into semi-orthogonal embedding for robust approximation, cubically reducing the computational cost for the inverse of multi-dimensional covariance tensor. With the scrutiny of ablation studies, the proposed method achieves a new state-of-the-art with significant margins for the MVTec AD, KolektorSDD, KolektorSDD2, and mSTC datasets. The theoretical and empirical analyses offer insights and verification of our straightforward yet cost-effective approach.


title: First measurement of the $CP$-violating phase in $B^0_s\to J/\psi(\to e^+e^-)\phi$ decays

abstract: A flavour-tagged time-dependent angular analysis of $B^0_s\to J/\psi\phi$ decays is presented where the $J/\psi$ meson is reconstructed through its decay to an $e^+e^-$ pair. The analysis uses a sample of $pp$ collision data recorded with the LHCb experiment at centre-of-mass energies of 7 and 8 TeV, corresponding to an integrated luminosity of 3 fb$^{-1}$. The $CP$-violating phase and lifetime parameters of the $B^0_s$ system are measured to be $\phi_s=0.00\pm0.28\pm0.07$ rad, $\Delta\Gamma_s=0.115\pm0.045\pm0.011$ ps$^{-1}$ and $\Gamma_s=0.608\pm0.018\pm0.012$ ps$^{-1}$ where the first uncertainty is statistical and the second systematic. This is the first time that $CP$-violating parameters are measured in the $B^0_s\to J/\psi\phi$ decay with an $e^+e^-$ pair in the final state. The results are consistent with previous measurements in other channels and with the Standard Model predictions.


title: Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization

abstract: Controllable person image generation aims to produce realistic human images with desirable attributes such as a given pose, cloth textures, or hairstyles. However, the large spatial misalignment between source and target images makes the standard image-to-image translation architectures unsuitable for this task. Most state-of-the-art methods focus on alignment for global pose-transfer tasks. However, they fail to deal with region-specific texture-transfer tasks, especially for person images with complex textures. To solve this problem, we propose a novel Spatially-Adaptive Warped Normalization (SAWN) which integrates a learned flow-field to warp modulation parameters. It allows us to efficiently align person spatially-adaptive styles with pose features. Moreover, we propose a novel Self-Training Part Replacement (STPR) strategy to refine the model for the texture-transfer task, which improves the quality of the generated clothes and the preservation ability of non-target regions. Our experimental results on the widely used DeepFashion dataset demonstrate a significant improvement of the proposed method over the state-of-the-art methods on pose-transfer and texture-transfer tasks. The code is available at https://github.com/zhangqianhui/Sawn.


title: A Study On the Effects of Pre-processing On Spatio-temporal Action Recognition Using Spiking Neural Networks Trained with STDP

abstract: There has been an increasing interest in spiking neural networks in recent years. SNNs are seen as hypothetical solutions for the bottlenecks of ANNs in pattern recognition, such as energy efficiency. But current methods such as ANN-to-SNN conversion and back-propagation do not take full advantage of these networks, and unsupervised methods have not yet reached a success comparable to advanced artificial neural networks. It is important to study the behavior of SNNs trained with unsupervised learning methods such as spike-timing dependent plasticity (STDP) on video classification tasks, including mechanisms to model motion information using spikes, as this information is critical for video understanding. This paper presents multiple methods of transposing temporal information into a static format, and then transforming the visual information into spikes using latency coding. These methods are paired with two types of temporal fusion known as early and late fusion, and are used to help the spiking neural network in capturing the spatio-temporal features from videos. In this paper, we rely on the network architecture of a convolutional spiking neural network trained with STDP, and we test the performance of this network when challenged with action recognition tasks. Understanding how a spiking neural network responds to different methods of movement extraction and representation can help reduce the performance gap between SNNs and ANNs. In this paper we show the effect of the similarity in the shape and speed of certain actions on action recognition with spiking neural networks, we also highlight the effectiveness of some methods compared to others.


title: An Adaptive Demand Response Framework using Price Elasticity Model in Distribution Networks: A Case Study

abstract: Price elasticity model (PEM) is an appealing and modest model for assessing the potential of flexible demand in DR. It measures the customers demand sensitivity through elasticity in relation to price variation. However, application of PEM in DR is partially apprehensible on attributing the adaptability and adjustability with intertemporal constraints in DR. Thus, this article presents an adaptive economic DR framework with attributes of DR via a dynamic elasticity approach to model customers sensitivity. This dynamic elasticity is modeled through the deterministic and stochastic approaches. Both approaches envision the notion of load recovery for shiftable/flexible loads to make the proposed DR framework adaptive and adjustable relative to price variation. In stochastic approach, a geometric Brownian motion is employed to emulate load recovery with inclusion of intertemporal constraint of load flexibility. The proposed mathematical model shows what should be the customers elasticity value to achieve the factual DR. The case study is carried out on standard IEEE 33 distribution system bus load data to assess technical and socio-economic impact of DR on customers and is also compared with the exiting model.


title: Active Learning of Continuous-time Bayesian Networks through Interventions

abstract: We consider the problem of learning structures and parameters of Continuous-time Bayesian Networks (CTBNs) from time-course data under minimal experimental resources. In practice, the cost of generating experimental data poses a bottleneck, especially in the natural and social sciences. A popular approach to overcome this is Bayesian optimal experimental design (BOED). However, BOED becomes infeasible in high-dimensional settings, as it involves integration over all possible experimental outcomes. We propose a novel criterion for experimental design based on a variational approximation of the expected information gain. We show that for CTBNs, a semi-analytical expression for this criterion can be calculated for structure and parameter learning. By doing so, we can replace sampling over experimental outcomes by solving the CTBNs master-equation, for which scalable approximations exist. This alleviates the computational burden of sampling possible experimental outcomes in high-dimensions. We employ this framework in order to recommend interventional sequences. In this context, we extend the CTBN model to conditional CTBNs in order to incorporate interventions. We demonstrate the performance of our criterion on synthetic and real-world data.


title: Variations in the pickup ion density structure in response to the growth of the Kelvin--Helmholtz instability along the heliopause

abstract: Features of the response of pickup ions (PUIs) to the Kelvin--Helmholtz instability (KHI) on the heliopause (HP) are examined by means of two-dimensional hybrid simulations. We assume the supersonic neutral solar wind as the source of PUIs gyrating about the magnetic field in the outer heliosheath. These PUIs become energetic neutral atoms (ENAs) via charge exchange with interstellar hydrogen, and a portion of these ENAs are detected by spacecraft such as the Interstellar Boundary Explorer (IBEX}. To evaluate the possibility of identifying the KHI on HP from ENA observations, we assume that an imprint of the KHI may be displayed in spatial and temporal variations in the observed ENA profile. As an alternative to ENA, the column density of PUIs integrated across the HP is calculated. The KH-inducing vortex forces not only background protons but also PUIs to roll up deep in the inner heliosheath. The KH vortex also results in the emission of magnetosonic pulses that sweep PUIs in the outer heliosheath and lead to their local confinement. These effects elongate the PUIs spatial distribution in the direction normal to the HP. The appearance of the local confined structure in the PUIs column density is consequently confirmed, and this feature can be confirmed as the KHI evolution. Although the simulation cannot be quantitatively compared with the observations currently available because its resolution is too small, we expect that the derived properties will be useful for diagnosing the nature of HP fluctuation in future missions.


title: Questioning the adequacy of certain quantum arrival-time distributions

abstract: It is shown that a class of exponentially decaying time-of-arrival probability distributions suggested by W{\l}odarz, Marchewka and Schuss, and Jurman and Nikoli\'c, as well as a semiclassical distribution implicit in time-of-flight momentum measurements, do not show the expected behavior for a Gaussian wave train. This casts doubts on the physical adequacy of these arrival-time proposals. In contrast, the quantum flux distribution (a special case of the Bohmian arrival-time distribution) displays the expected behavior.


title: Impact of axions on the Cassiopea A neutron star cooling

abstract: The observed anomalous steady decrease in surface temperature of the supernova remnant Cassiopeia A (Cas A), which was reported about ten years ago, has generated much debate. Several exotic cooling scenarios have been proposed using non-standard assumptions about the physics and evolution of this neutron star (NS). At present, significant corrections have been made to the observational data, which make it possible to numerically simulate the Cas A NS cooling process in the framework of the scenario of minimal neutrino cooling. If there is an additional source of cooling, such as axion emission, the steepness of the Cas A NS surface temperature drop will increase with the growth of the axion-nucleon interaction strength. This makes it possible to limit the minimum value of the axion decay constant $f_a$ using the condition that the NS surface temperature should be within the 99% confidence interval obtained from the observational data. Two types of axion models are considered: the Kim-Shifman-Weinstein-Zakharov -- KSVZ model and the Dean-Fischler-Srednitsky-Zhitnitsky --DFSZ model. The above criterion gives a lower limit on the axion decay constant, $f_a>3\times 10^7$ GeV and $f_a>4.5\times 10^8$ GeV for KSVZ and DFSZ axions, respectively.


title: Complex-domain super-resolution imaging with distributed optimization

abstract: Complex-domain imaging has emerged as a valuable technique for investigating weak-scattered samples. However, due to the detector's pursuit of large pixel size for high throughput, the resolution limitation impedes its further development. In this work, we report a lensless on-chip complex-domain imaging system, together with a distributed-optimization-based pixel super-resolution technique (DO-PSR). The system employs a diffuser shifting to realize phase modulation and increases observation diversity. The corresponding DO-PSR technique derives an alternating projection operator and an enhancing neural network to tackle the measurement fidelity and statistical prior regularization subproblems. Extensive experiments show that the system outperforms the existing techniques with as much as 11dB on PSNR, and one-order-of-magnitude higher cell counting precision.


title: Graph-signal Reconstruction and Blind Deconvolution for Structured Inputs

abstract: Key to successfully deal with complex contemporary datasets is the development of tractable models that account for the irregular structure of the information at hand. This paper provides a comprehensive and unifying view of several sampling, reconstruction, and recovery problems for signals defined on irregular domains that can be accurately represented by a graph. The workhorse assumption is that the (partially) observed signals can be modeled as the output of a graph filter to a structured (parsimonious) input graph signal. When either the input or the filter coefficients are known, this is tantamount to assuming that the signals of interest live on a subspace defined by the supporting graph. When neither is known, the model becomes bilinear. Upon imposing different priors and additional structure on either the input or the filter coefficients, a broad range of relevant problem formulations arise. The goal is then to leverage those priors, the shift operator of the supporting graph, and the samples of the signal of interest to recover: the signal at the non-sampled nodes (graph-signal interpolation), the input (deconvolution), the filter coefficients (system identification), or any combination thereof (blind deconvolution).


title: Diffy: Inductive Reasoning of Array Programs using Difference Invariants

abstract: We present a novel verification technique to prove interesting properties of a class of array programs with a symbolic parameter N denoting the size of arrays. The technique relies on constructing two slightly different versions of the same program. It infers difference relations between the corresponding variables at key control points of the joint control-flow graph of the two program versions. The desired post-condition is then proved by inducting on the program parameter $N$, wherein the difference invariants are crucially used in the inductive step. This contrasts with classical techniques that rely on finding potentially complex loop invaraints for each loop in the program. Our synergistic combination of inductive reasoning and finding simple difference invariants helps prove properties of programs that cannot be proved even by the winner of Arrays sub-category from SV-COMP 2021. We have implemented a prototype tool called diffy to demonstrate these ideas. We present results comparing the performance of diffy with that of state-of-the-art tools.


title: Heat Transport in Herbertsmithite: Can a Quantum Spin Liquid Survive Disorder?

abstract: Arguably the most favorable situation for spins to enter the long-sought quantum spin liquid (QSL) state is when they sit on a kagome lattice. No consensus has been reached in theory regarding the true ground state of this promising platform. The experimental efforts, relying mostly on one archetypal material ZnCu$_3$(OH)$_6$Cl$_2$, have also led to diverse possibilities. Apart from subtle interactions in the Hamiltonian, there is the additional degree of complexity associated with disorder in the real material ZnCu$_3$(OH)$_6$Cl$_2$ that haunts most experimental probes. Here we resort to heat transport measurement, a cleaner probe in which instead of contributing directly, the disorder only impacts the signal from the kagome spins. For ZnCu$_3$(OH)$_6$Cl$_2$ and a related QSL candidate Cu$_3$Zn(OH)$_6$FBr, we observed no contribution by any spin excitation nor any field-induced change to the thermal conductivity. These results impose different constraints on various scenarios about the ground state of these two kagome compounds: while a gapped QSL, or certain quantum paramagnetic state other than a QSL, is compatible with our results, a gapless QSL must be dramatically modified by the disorder so that gapless spin excitations are localized.


title: Active Hierarchical Exploration with Stable Subgoal Representation Learning

abstract: Goal-conditioned hierarchical reinforcement learning (GCHRL) provides a promising approach to solving long-horizon tasks. Recently, its success has been extended to more general settings by concurrently learning hierarchical policies and subgoal representations. Although GCHRL possesses superior exploration ability by decomposing tasks via subgoals, existing GCHRL methods struggle in temporally extended tasks with sparse external rewards, since the high-level policy learning relies on external rewards. As the high-level policy selects subgoals in an online learned representation space, the dynamic change of the subgoal space severely hinders effective high-level exploration. In this paper, we propose a novel regularization that contributes to both stable and efficient subgoal representation learning. Building upon the stable representation, we design measures of novelty and potential for subgoals, and develop an active hierarchical exploration strategy that seeks out new promising subgoals and states without intrinsic rewards. Experimental results show that our approach significantly outperforms state-of-the-art baselines in continuous control tasks with sparse rewards.


title: Effects of the linear polarization of polariton condensates in their propagation in codirectional couplers

abstract: We report on the linear polarization of polariton condensates in a codirectional coupler that allows evanescent coupling between adjacent waveguides. We observe polarization-dependent intensity oscillations in the output terminal of the coupler that we identify as the mode beating between the linear-polarized eigenmodes.


title: Regression-Adjusted Estimation of Quantile Treatment Effects under Covariate-Adaptive Randomizations

abstract: Datasets from field experiments with covariate-adaptive randomizations (CARs) usually contain extra covariates in addition to the strata indicators. We propose to incorporate these additional covariates via auxiliary regressions in the estimation and inference of unconditional quantile treatment effects (QTEs) under CARs. We establish the consistency and limit distribution of the regression-adjusted QTE estimator and prove that the use of multiplier bootstrap inference is non-conservative under CARs. The auxiliary regression may be estimated parametrically, nonparametrically, or via regularization when the data are high-dimensional. Even when the auxiliary regression is misspecified, the proposed bootstrap inferential procedure still achieves the nominal rejection probability in the limit under the null. When the auxiliary regression is correctly specified, the regression-adjusted estimator achieves the minimum asymptotic variance. We also discuss forms of adjustments that can improve the efficiency of the QTE estimators. The finite sample performance of the new estimation and inferential methods is studied in simulations and an empirical application to a well-known dataset concerned with expanding access to basic bank accounts on savings is reported.


title: Bio-inspired visual attention for silicon retinas based on spiking neural networks applied to pattern classification

abstract: Visual attention can be defined as the behavioral and cognitive process of selectively focusing on a discrete aspect of sensory cues while disregarding other perceivable information. This biological mechanism, more specifically saliency detection, has long been used in multimedia indexing to drive the analysis only on relevant parts of images or videos for further processing. The recent advent of silicon retinas (or event cameras -- sensors that measure pixel-wise changes in brightness and output asynchronous events accordingly) raises the question of how to adapt attention and saliency to the unconventional type of such sensors' output. Silicon retina aims to reproduce the biological retina behaviour. In that respect, they produce punctual events in time that can be construed as neural spikes and interpreted as such by a neural network. In particular, Spiking Neural Networks (SNNs) represent an asynchronous type of artificial neural network closer to biology than traditional artificial networks, mainly because they seek to mimic the dynamics of neural membrane and action potentials over time. SNNs receive and process information in the form of spike trains. Therefore, they make for a suitable candidate for the efficient processing and classification of incoming event patterns measured by silicon retinas. In this paper, we review the biological background behind the attentional mechanism, and introduce a case study of event videos classification with SNNs, using a biology-grounded low-level computational attention mechanism, with interesting preliminary results.


title: List-decoding and list-recovery of Reed-Solomon codes beyond the Johnson radius for any rate

abstract: Understanding the limits of list-decoding and list-recovery of Reed-Solomon (RS) codes is of prime interest in coding theory and has attracted a lot of attention in recent decades. However, the best possible parameters for these problems are still unknown, and in this paper, we take a step in this direction. We show the existence of RS codes that are list-decodable or list-recoverable beyond the Johnson radius for \emph{any} rate, with a polynomial field size in the block length. In particular, we show that for any $\epsilon\in (0,1)$ there exist RS codes that are list-decodable from radius $1-\epsilon$ and rate less than $\frac{\epsilon}{2-\epsilon}$, with constant list size. We deduce our results by extending and strengthening a recent result of Ferber, Kwan, and Sauermann on puncturing codes with large minimum distance and by utilizing the underlying code's linearity.


title: Parallel transport dynamics for mixed quantum states with applications to time-dependent density functional theory

abstract: Direct simulation of the von Neumann dynamics for a general (pure or mixed) quantum state can often be expensive. One prominent example is the real-time time-dependent density functional theory (rt-TDDFT), a widely used framework for the first principle description of many-electron dynamics in chemical and materials systems. Practical rt-TDDFT calculations often avoid the direct simulation of the von Neumann equation, and solve instead a set of Schr\"odinger equations, of which the dynamics is equivalent to that of the von Neumann equation. However, the time step size employed by the Schr\"odinger dynamics is often much smaller. In order to improve the time step size and the overall efficiency of the simulation, we generalize a recent work of the parallel transport (PT) dynamics for simulating pure states [An, Lin, Multiscale Model. Simul. 18, 612, 2020] to general quantum states. The PT dynamics provides the optimal gauge choice, and can employ a time step size comparable to that of the von Neumann dynamics. Going beyond the linear and near adiabatic regime in previous studies, we find that the error of the PT dynamics can be bounded by certain commutators between Hamiltonians, density matrices, and their derived quantities. Such a commutator structure is not present in the Schr\"odinger dynamics. We demonstrate that the parallel transport-implicit midpoint (PT-IM) method is a suitable method for simulating the PT dynamics, especially when the spectral radius of the Hamiltonian is large. The commutator structure of the error bound, and numerical results for model rt-TDDFT calculations in both linear and nonlinear regimes, confirm the advantage of the PT dynamics.


title: A Protection Method of Trained CNN Model with Secret Key from Unauthorized Access

abstract: In this paper, we propose a novel method for protecting convolutional neural network (CNN) models with a secret key set so that unauthorized users without the correct key set cannot access trained models. The method enables us to protect not only from copyright infringement but also the functionality of a model from unauthorized access without any noticeable overhead. We introduce three block-wise transformations with a secret key set to generate learnable transformed images: pixel shuffling, negative/positive transformation, and FFX encryption. Protected models are trained by using transformed images. The results of experiments with the CIFAR and ImageNet datasets show that the performance of a protected model was close to that of non-protected models when the key set was correct, while the accuracy severely dropped when an incorrect key set was given. The protected model was also demonstrated to be robust against various attacks. Compared with the state-of-the-art model protection with passports, the proposed method does not have any additional layers in the network, and therefore, there is no overhead during training and inference processes.


title: Predicting Intrinsic Antiferromagnetic and Ferroelastic MnF4 monolayer with Controllable Magnetization

abstract: Two-dimensional (2D) multiferroic materials with controllable magnetism have promising prospects in miniaturized quantum device applications, such as high-density data storage and spintronic devices. Here, using first-principles calculations, we propose a coexistence of antiferromagnetism and ferroelasticity in multiferroic $MnF_{4}$ monolayer. The $MnF_{4}$ monolayer is found to be an intrinsic wide-gap semiconductor with large spin polarization ~3 $\mu_{B}$/Mn, in which the antiferromagnetic order originates from the cooperation and competition of the direct exchange and super exchange. $MnF_{4}$ monolayer is also characterized by strongly uniaxial magnetic anisotropic behavior, that can be manipulated by the reversible ferroelastic strain and carrier doping. Remarkably, the carrier doping not only leads to an antiferromagnetic to ferromagnetic phase transformation, bult also could switch the easy magnetization axis between the in-plane and out-of-plane directions. In addition, the N\'eel temperature was evaluated to be about 140 K from the Monte Carlo simulations based on the Heisenberg model. The combination of antiferromagnetic and ferroelastic properties in $MnF_{4}$ monolayer provides a promising platform for studying the magnetoelastic effects, and brings about new concepts for next-generation nonvolatile memory and multi-stage storage.


title: Low-Dose CT Denoising Using a Structure-Preserving Kernel Prediction Network

abstract: Low-dose CT has been a key diagnostic imaging modality to reduce the potential risk of radiation overdose to patient health. Despite recent advances, CNN-based approaches typically apply filters in a spatially invariant way and adopt similar pixel-level losses, which treat all regions of the CT image equally and can be inefficient when fine-grained structures coexist with non-uniformly distributed noises. To address this issue, we propose a Structure-preserving Kernel Prediction Network (StructKPN) that combines the kernel prediction network with a structure-aware loss function that utilizes the pixel gradient statistics and guides the model towards spatially-variant filters that enhance noise removal, prevent over-smoothing and preserve detailed structures for different regions in CT imaging. Extensive experiments demonstrated that our approach achieved superior performance on both synthetic and non-synthetic datasets, and better preserves structures that are highly desired in clinical screening and low-dose protocol optimization.


title: The x-index: A new citation-distance-based index to measure academic influence

abstract: An important issue in the field of academic measurement is how to evaluate academic influence scientifically and comprehensively, which can help government and research organizations better allocate academic resources and recruit researchers. It is generally accepted that using weighted citations to measure academic influence is more reasonable than treating all citations equally. Given the limitations of the existing c-index, the first index in bibliometric literature that measures output based on the quantity and quality of received citations, we propose the x-index, which assigns weight to each citation according to its distance. By defining collaboration distance and citation distance, we first analyze the properties of the collaboration network and citation distance, then perform theoretical and empirical analyses on c-index to reveal its shortcomings, finally, we suggest the x-index and conduct experiments and analysis on the x-index. Experimental results demonstrate that compared with the c-index, h-index, and g-index, the x-index shows a stronger discriminatory power.


title: Multi-Objective LQG Design with Primal-Dual Method

abstract: The goal of this paper is to study a multi-objective linear quadratic Gaussian (LQG) control problem. In particular, we consider an optimal control problem minimizing a quadratic cost over a finite time horizon for linear stochastic systems subject to control energy constraints. To solve the problem, we suggest an efficient bisection line search algorithm which is computationally efficient compared to other approaches such as the semidefinite programming. The main idea is to use the Lagrangian function and Karush-Kuhn-Tucker (KKT) optimality conditions to solve the constrained optimization problem. The Lagrange multiplier is searched using the bisection line search. Numerical examples are given to demonstrate the effectiveness of the proposed methods.


title: G-Transformer for Document-level Machine Translation

abstract: Document-level MT models are still far from satisfactory. Existing work extend translation unit from single sentence to multiple sentences. However, study shows that when we further enlarge the translation unit to a whole document, supervised training of Transformer can fail. In this paper, we find such failure is not caused by overfitting, but by sticking around local minima during training. Our analysis shows that the increased complexity of target-to-source attention is a reason for the failure. As a solution, we propose G-Transformer, introducing locality assumption as an inductive bias into Transformer, reducing the hypothesis space of the attention from target to source. Experiments show that G-Transformer converges faster and more stably than Transformer, achieving new state-of-the-art BLEU scores for both non-pretraining and pre-training settings on three benchmark datasets.


title: Emotional Voice Conversion: Theory, Databases and ESD

abstract: In this paper, we first provide a review of the state-of-the-art emotional voice conversion research, and the existing emotional speech databases. We then motivate the development of a novel emotional speech database (ESD) that addresses the increasing research need. With this paper, the ESD database is now made available to the research community. The ESD database consists of 350 parallel utterances spoken by 10 native English and 10 native Chinese speakers and covers 5 emotion categories (neutral, happy, angry, sad and surprise). More than 29 hours of speech data were recorded in a controlled acoustic environment. The database is suitable for multi-speaker and cross-lingual emotional voice conversion studies. As case studies, we implement several state-of-the-art emotional voice conversion systems on the ESD database. This paper provides a reference study on ESD in conjunction with its release.


title: Robustness of Helical Edge States Under Edge Reconstruction

abstract: The helical edge states of time-reversal invariant two-dimensional topological insulators are protected against backscattering in idealized models. In more realistic scenarios with a shallow confining potential at the sample boundary, additional strongly interacting edge states may arise, that could interfere with the topological protection of edge conduction. We find that interaction effects within the reconstructed edges are well described by the Luttinger liquid model. While interactions between this Luttinger liquid and the helical edge states can in principle give rise to dynamical spin polarization and the breaking of time-reversal symmetry, we demonstrate that random spin-orbit coupling strongly suppresses such dynamical spin polarization, resulting in the persistence of near quantized edge conduction.


title: Bimanual Shelf Picking Planner Based on Collapse Prediction

abstract: In logistics warehouse, since many objects are randomly stacked on shelves, it becomes difficult for a robot to safely extract one of the objects without other objects falling from the shelf. In previous works, a robot needed to extract the target object after rearranging the neighboring objects. In contrast, humans extract an object from a shelf while supporting other neighboring objects. In this paper, we propose a bimanual manipulation planner based on collapse prediction trained with data generated from a physics simulator, which can safely extract a single object while supporting the other object. We confirmed that the proposed method achieves more than 80% success rate for safe extraction by real-world experiments using a dual-arm manipulator.


title: Two-dimensional Ferroelectric Ferromagnetic Half Semiconductor in VOF monolayer

abstract: Two-dimensional (2D) multiferroics have been casted great attention owing to their promising prospects for miniaturized electronic and memory devices.Here, we proposed a highly stable 2D multiferroic, VOF monolayer, which is an intrinsic ferromagnetic half semiconductor with large spin polarization ~2 $\mu_{B}/V$ atom and a significant uniaxial magnetic anisotropy along a-axis (410 $\mu eV/V$ atom). Meanwhile, it shows excellent ferroelectricity with a large spontaneous polarization 32.7 $\mu C/cm^{2}$ and a moderate energy barrier (~43 meV/atom) between two ferroelectric states, which can be ascribed to the Jahn-Teller distortion.Moreover, VOF monolayer harbors an ultra-large negative Poisson's ratio in the in-plane direction (~-0.34). The Curie temperature evaluated from the Monte Carlo simulations based on the Ising model is about 215 K, which can be enhanced room temperature under -4% compressive biaxial strain.The combination of ferromagnetism and ferroelectricity in the VOF monolayer could provide a promising platform for future study of multiferroic effects and next-generation multifunctional nanoelectronic device applications.


title: BaMBNet: A Blur-aware Multi-branch Network for Defocus Deblurring

abstract: The defocus deblurring raised from the finite aperture size and exposure time is an essential problem in the computational photography. It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods. Due to its great breakthrough in low-level tasks, convolutional neural networks (CNNs) have been introduced to the defocus deblurring problem and achieved significant progress. However, they apply the same kernel for different regions of the defocus blurred images, thus it is difficult to handle these nonuniform blurred images. To this end, this study designs a novel blur-aware multi-branch network (BaMBNet), in which different regions (with different blur amounts) should be treated differentially. In particular, we estimate the blur amounts of different regions by the internal geometric constraint of the DP data, which measures the defocus disparity between the left and right views. Based on the assumption that different image regions with different blur amounts have different deblurring difficulties, we leverage different networks with different capacities (\emph{i.e.} parameters) to process different image regions. Moreover, we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch. In this way, we can expect to well maintain the information of the clear regions while recovering the missing details of the blurred regions. Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art methods. Source code will be available at https://github.com/junjun-jiang/BaMBNet.


title: Exclusive electro-weak production of a charmed meson at high energy

abstract: Exclusive electro-weak processes have peculiar features which make them complementary to usually discussed deeply virtual electroproduction processes such as deep virtual Compton scattering or meson production (and the corresponding crossed reactions). They allow in particular single charmed meson production, which we study in two different contexts : electroproduction at an electron ion collider and neutrino-production at a medium energy neutrino facility. We rely on the QCD collinear factorization framework where generalized parton distributions allow physicists to perform a nucleon tomography.


title: Securing IoT Devices by Exploiting Backscatter Propagation Signatures

abstract: The low-power radio technologies open up many opportunities to facilitate Internet-of-Things (IoT) into our daily life, while their minimalist design also makes IoT devices vulnerable to many active attacks. Recent advances use an antenna array to extract fine-grained physical-layer signatures to identify the attackers, which adds burdens in terms of energy and hardware cost to IoT devices. In this paper, we present ShieldScatter, a lightweight system that attaches low-cost tags to single-antenna devices to shield the system from active attacks. The key insight of ShieldScatter is to intentionally create multi-path propagation signatures with the careful deployment of tags. These signatures can be used to construct a sensitive profile to identify the location of the signals' arrival, and thus detect the threat. In addition, we also design a tag-random scheme and a multiple receivers combination approach to detect a powerful attacker who has the strong priori knowledge of the legitimate user. We prototype ShieldScatter with USRPs and tags to evaluate our system in various environments. The results show that even when the powerful attacker is close to the legitimate device, ShieldScatter can mitigate 95% of attack attempts while triggering false alarms on just 7% of legitimate traffic.


title: Gillian: A Multi-Language Platform for Unified Symbolic Analysis

abstract: This is an evolving document describing the meta-theory, the implementation, and the instantiations of Gillian, a multi-language symbolic analysis platform.


title: The CARMENES search for exoplanets around M dwarfs: Spectroscopic orbits of nine M-dwarf multiple systems, including two triples, two brown dwarf candidates, and one close M-dwarf-white dwarf binary

abstract: M dwarfs are ideal targets for the search of Earth-size planets in the habitable zone using the radial velocity method, attracting the attention of many ongoing surveys. As a by-product of these surveys, new multiple stellar systems are also found. This is the case also for the CARMENES survey, from which nine new SB2 systems have already been announced. Throughout the five years of the survey, the accumulation of new observations has resulted in the detection of several new multiple stellar systems with long periods and low radial-velocity amplitudes. Here, we newly characterise the spectroscopic orbits and constrain the masses of eight systems and update the properties of a system that we reported earlier. We derive the radial velocities of the stars using two-dimensional cross correlation techniques and template matching. The measurements are modelled to determine the orbital parameters of the systems. We combine CARMENES spectroscopic observations with archival high-resolution spectra from other instruments to increase the time-span of the observations and improve our analysis. When available, we also added archival photometric, astrometric, and adaptive optics imaging data to constrain the rotation periods and absolute masses of the components. We determine the spectroscopic orbits of nine multiple systems, eight of which are presented for the first time. The sample is composed of five SB1s, two SB2s, and two ST3s. The companions of two of the single-line binaries, GJ 3626 and GJ 912, have minimum masses below the stellar boundary and, thus, could be brown dwarfs. We find a new white dwarf in a close binary orbit around the M star GJ 207.1. From a global fit to radial velocities and astrometric measurements, we are able to determine the absolute masses of the components of GJ 282C, which is one of the youngest systems with measured dynamical masses.


title: Spectral walls in multifield kink dynamics

abstract: We show that spectral walls are common phenomena in the dynamics of kinks in (1+1) dimensions. They occur in models based on two or more scalar fields with a nonempty Bogomol'nyi-Prasam-Sommerfield (BPS) sector, hosting two zero modes, where they are one of the main factors governing the soliton dynamics. We also show that spectral walls appear as singularities of the dynamical vibrational moduli space.


title: Energy-Efficient and Federated Meta-Learning via Projected Stochastic Gradient Ascent

abstract: In this paper, we propose an energy-efficient federated meta-learning framework. The objective is to enable learning a meta-model that can be fine-tuned to a new task with a few number of samples in a distributed setting and at low computation and communication energy consumption. We assume that each task is owned by a separate agent, so a limited number of tasks is used to train a meta-model. Assuming each task was trained offline on the agent's local data, we propose a lightweight algorithm that starts from the local models of all agents, and in a backward manner using projected stochastic gradient ascent (P-SGA) finds a meta-model. The proposed method avoids complex computations such as computing hessian, double looping, and matrix inversion, while achieving high performance at significantly less energy consumption compared to the state-of-the-art methods such as MAML and iMAML on conducted experiments for sinusoid regression and image classification tasks.


title: Learning Inductive Attention Guidance for Partially Supervised Pancreatic Ductal Adenocarcinoma Prediction

abstract: Pancreatic ductal adenocarcinoma (PDAC) is the third most common cause of cancer death in the United States. Predicting tumors like PDACs (including both classification and segmentation) from medical images by deep learning is becoming a growing trend, but usually a large number of annotated data are required for training, which is very labor-intensive and time-consuming. In this paper, we consider a partially supervised setting, where cheap image-level annotations are provided for all the training data, and the costly per-voxel annotations are only available for a subset of them. We propose an Inductive Attention Guidance Network (IAG-Net) to jointly learn a global image-level classifier for normal/PDAC classification and a local voxel-level classifier for semi-supervised PDAC segmentation. We instantiate both the global and the local classifiers by multiple instance learning (MIL), where the attention guidance, indicating roughly where the PDAC regions are, is the key to bridging them: For global MIL based normal/PDAC classification, attention serves as a weight for each instance (voxel) during MIL pooling, which eliminates the distraction from the background; For local MIL based semi-supervised PDAC segmentation, the attention guidance is inductive, which not only provides bag-level pseudo-labels to training data without per-voxel annotations for MIL training, but also acts as a proxy of an instance-level classifier. Experimental results show that our IAG-Net boosts PDAC segmentation accuracy by more than 5% compared with the state-of-the-arts.


title: LIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP features

abstract: We describe our approach for SemEval-2021 task 6 on detection of persuasion techniques in multimodal content (memes). Our system combines pretrained multimodal models (CLIP) and chained classifiers. Also, we propose to enrich the data by a data augmentation technique. Our submission achieves a rank of 8/16 in terms of F1-micro and 9/16 with F1-macro on the test set.


title: Modified $GW$ Method in Electronic Systems

abstract: A modified $GW$ approximation to many - body systems is developed. The approximation has the same computational complexity as the traditional $GW$ approach, but uses a different truncation scheme. This scheme neglects high order connected correlation functions. A covariant (preserving Ward identities due to charge conservation) scheme for two - body correlators is employed, which holds the relation between the charge correlator and charge susceptibility. The method is tested on the two - dimensional one - band Hubbard model. Results are compared with exact diagonalization, the fluctuation - exchange (FLEX) theory and determinantal quantum Monte Carlo (DQMC) approach. The comparison for the (one - body) Green's function demonstrates that it is more precise in strong - coupling regime (especially away from half - filling) than similar - complexity approximations $GW$ or FLEX. The charge correlator is in excellent agreement with the numerically exact result obtained from DQMC.


title: Fragmentation model and strewn field estimation for meteoroids entry

abstract: Everyday thousands of meteoroids enter the Earth's atmosphere. The vast majority burn up harmlessly during the descent, but the larger objects survive, occasionally experiencing intense fragmentation events, and reach the ground. These events can pose a threat for a village or a small city; therefore, models of asteroid fragmentation, along with accurate post-breakup trajectory and strewn field estimation, are needed to enable a reliable risk assessment. In this work, a methodology to describe meteoroids entry, fragmentation, descent, and strewn field is presented by means of a continuum approach. At breakup, a modified version of the NASA Standard Breakup Model is used to generate the distribution of the fragments in terms of their area-to-mass ratio and ejection velocity. This distribution, combined with the meteoroid state, is directly propagated using the continuity equation coupled with the non-linear entry dynamics. At each time step, the probability density evolution of the fragments is reconstructed using GMM interpolation. Using this information is then possible to estimate the meteoroid's ground impact probability. This approach departs from the current state-of-the-art models: it has the flexibility to include large fragmentation events while maintaining a continuum formulation for a better physical representation of the phenomenon. The methodology is also characterised by a modular structure, so that updated asteroids fragmentation models can be readily integrated into the framework, allowing a continuously improving prediction of re-entry and fragmentation events. The propagation of the fragments' density and its reconstruction, currently considering only one fragmentation point, is first compared against Monte Carlo simulations, and then against real observations. Both deceleration due to atmospheric drag and ablation due to aerothermodynamics effects have been considered.


title: Theory of quasi-exact fault-tolerant quantum computing and valence-bond-solid codes

abstract: In this work, we develop the theory of quasi-exact fault-tolerant quantum (QEQ) computation, which uses qubits encoded into quasi-exact quantum error-correction codes ("quasi codes"). By definition, a quasi code is a parametric approximate code that can become exact by tuning its parameters. The model of QEQ computation lies in between the two well-known ones: the usual noisy quantum computation without error correction and the usual fault-tolerant quantum computation, but closer to the later. Many notions of exact quantum codes need to be adjusted for the quasi setting. Here we develop quasi error-correction theory using quantum instrument, the notions of quasi universality, quasi code distances, and quasi thresholds, etc. We find a wide class of quasi codes which are called valence-bond-solid codes, and we use them as concrete examples to demonstrate QEQ computation.


title: Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation

abstract: Table-to-text generation refers to generating a descriptive text from a key-value table. Traditional autoregressive methods, though can generate text with high fluency, suffer from low coverage and poor faithfulness problems. To mitigate these problems, we propose a novel Skeleton-based two-stage method that combines both Autoregressive and Non-Autoregressive generations (SANA). Our approach includes: (1) skeleton generation with an autoregressive pointer network to select key tokens from the source table; (2) edit-based non-autoregressive generation model to produce texts via iterative insertion and deletion operations. By integrating hard constraints from the skeleton, the non-autoregressive model improves the generation's coverage over the source table and thus enhances its faithfulness. We conduct automatic and human evaluations on both WikiPerson and WikiBio datasets. Experimental results demonstrate that our method outperforms the previous state-of-the-art methods in both automatic and human evaluation, especially on coverage and faithfulness. In particular, we achieve PARENT-T recall of 99.47 in WikiPerson, improving over the existing best results by more than 10 points.


title: Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASR

abstract: With the advent of globalization, there is an increasing demand for multilingual automatic speech recognition (ASR), handling language and dialectal variation of spoken content. Recent studies show its efficacy over monolingual systems. In this study, we design a large multilingual end-to-end ASR using self-attention based conformer architecture. We trained the system using Arabic (Ar), English (En) and French (Fr) languages. We evaluate the system performance handling: (i) monolingual (Ar, En and Fr); (ii) multi-dialectal (Modern Standard Arabic, along with dialectal variation such as Egyptian and Moroccan); (iii) code-switching -- cross-lingual (Ar-En/Fr) and dialectal (MSA-Egyptian dialect) test cases, and compare with current state-of-the-art systems. Furthermore, we investigate the influence of different embedding/character representations including character vs word-piece; shared vs distinct input symbol per language. Our findings demonstrate the strength of such a model by outperforming state-of-the-art monolingual dialectal Arabic and code-switching Arabic ASR.


title: Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learning

abstract: The idea of transfer in reinforcement learning (TRL) is intriguing: being able to transfer knowledge from one problem to another problem without learning everything from scratch. This promises quicker learning and learning more complex methods. To gain an insight into the field and to detect emerging trends, we performed a database search. We note a surprisingly late adoption of deep learning that starts in 2018. The introduction of deep learning has not yet solved the greatest challenge of TRL: generalization. Transfer between different domains works well when domains have strong similarities (e.g. MountainCar to Cartpole), and most TRL publications focus on different tasks within the same domain that have few differences. Most TRL applications we encountered compare their improvements against self-defined baselines, and the field is still missing unified benchmarks. We consider this to be a disappointing situation. For the future, we note that: (1) A clear measure of task similarity is needed. (2) Generalization needs to improve. Promising approaches merge deep learning with planning via MCTS or introduce memory through LSTMs. (3) The lack of benchmarking tools will be remedied to enable meaningful comparison and measure progress. Already Alchemy and Meta-World are emerging as interesting benchmark suites. We note that another development, the increase in procedural content generation (PCG), can improve both benchmarking and generalization in TRL.


title: A Semantic-based Method for Unsupervised Commonsense Question Answering

abstract: Unsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score candidate choices directly conditioned on the question or context. However, such scores from language models can be easily affected by irrelevant factors, such as word frequencies, sentence structures, etc. These distracting factors may not only mislead the model to choose a wrong answer but also make it oversensitive to lexical perturbations in candidate answers. In this paper, we present a novel SEmantic-based Question Answering method (SEQA) for unsupervised commonsense question answering. Instead of directly scoring each answer choice, our method first generates a set of plausible answers with generative models (e.g., GPT-2), and then uses these plausible answers to select the correct choice by considering the semantic similarity between each plausible answer and each choice. We devise a simple, yet sound formalism for this idea and verify its effectiveness and robustness with extensive experiments. We evaluate the proposed method on four benchmark datasets, and our method achieves the best results in unsupervised settings. Moreover, when attacked by TextFooler with synonym replacement, SEQA demonstrates much less performance drops than baselines, thereby indicating stronger robustness.


title: Auto-Differentiable Spectrum Model for High-Dispersion Characterization of Exoplanets and Brown Dwarfs

abstract: We present an auto-differentiable spectral modeling of exoplanets and brown dwarfs. This model enables a fully Bayesian inference of the high--dispersion data to fit the ab initio line-by-line spectral computation to the observed spectrum by combining it with the Hamiltonian Monte Carlo in recent probabilistic programming languages. An open source code, exojax, developed in this study, was written in Python using the GPU/TPU compatible package for automatic differentiation and accelerated linear algebra, JAX (Bradbury et al. 2018). We validated the model by comparing it with existing opacity calculators and a radiative transfer code and found reasonable agreements of the output. As a demonstration, we analyzed the high-dispersion spectrum of a nearby brown dwarf, Luhman 16 A and found that a model including water, carbon monoxide, and $\mathrm{H_2/He}$ collision induced absorption was well fitted to the observed spectrum ($R=10^5$ and 2.28-2.30 $\mu$m). As a result, we found that $T_0=1295_{-32}^{+35}$ K at 1 bar and C/O $=0.62 \pm 0.03$, which is slightly higher than the solar value. This work demonstrates the potential of full Bayesian analysis of brown dwarfs and exoplanets as observed by high-dispersion spectrographs and also directly-imaged exoplanets as observed by high-dispersion coronagraphy.


title: Electryo, In-person Voting with Transparent Voter Verifiability and Eligibility Verifiability

abstract: Selene is an e-voting protocol that allows voters to directly check their individual vote, in cleartext, in the final tally via a tracker system, while providing good coercion mitigation. This is in contrast to conventional, end-to-end verifiable schemes in which the voter verifies the presence of an encryption of her vote on the bulletin board. The Selene mechanism can be applied to many e-voting schemes, but here we present an application to the polling station context, resulting in a voter-verifiable electronic tally with a paper audit trail. The system uses a smartcard-based public key system to provide the individual verification and universal eligibility verifiability. The paper record contains an encrypted link to the voter's identity, requiring stronger assumptions on ballot privacy than normal paper voting, but with the benefit of providing good auditability and dispute resolution as well as supporting (comparison) risk limiting audits.