title: Deviance Matrix Factorization

abstract: We investigate a general matrix factorization for deviance-based data losses, extending the ubiquitous singular value decomposition beyond squared error loss. While similar approaches have been explored before, our method leverages classical statistical methodology from generalized linear models (GLMs) and provides an efficient algorithm that is flexible enough to allow for structural zeros via entry weights. Moreover, by adapting results from GLM theory, we provide support for these decompositions by (i) showing strong consistency under the GLM setup, (ii) checking the adequacy of a chosen exponential family via a generalized Hosmer-Lemeshow test, and (iii) determining the rank of the decomposition via a maximum eigenvalue gap method. To further support our findings, we conduct simulation studies to assess robustness to decomposition assumptions and extensive case studies using benchmark datasets from image face recognition, natural language processing, network analysis, and biomedical studies. Our theoretical and empirical results indicate that the proposed decomposition is more flexible, general, and robust, and can thus provide improved performance when compared to similar methods. To facilitate applications, an R package with efficient model fitting and family and rank determination is also provided.


title: Strong convergence rates of a fully discrete scheme for nonlinear stochastic partial differential equations with non-globally Lipschitz coefficients driven by multiplicative noise

abstract: We consider a fully discrete scheme for nonlinear stochastic partial differential equations with non-globally Lipschitz coefficients driven by multiplicative noise in a multi-dimensional setting. Our method uses a polynomial based spectral method in space, so it does not require the elliptic operator $A$ and the covariance operator $Q$ of noise in the equation commute, and thus successfully alleviates a restriction of Fourier spectral method for SPDEs pointed out by Jentzen, Kloeden and Winkel. The discretization in time is a tamed semi-implicit scheme which treats the nonlinear term explicitly while being unconditionally stable. Under regular assumptions which are usually made for SPDEs with additive noise, we establish optimal strong convergence rates in both space and time for our fully discrete scheme. We also present numerical experiments which are consistent with our theoretical results.


title: Improved Heatmap-based Landmark Detection

abstract: Mitral valve repair is a very difficult operation, often requiring experienced surgeons. The doctor will insert a prosthetic ring to aid in the restoration of heart function. The location of the prosthesis' sutures is critical. Obtaining and studying them during the procedure is a valuable learning experience for new surgeons. This paper proposes a landmark detection network for detecting sutures in endoscopic pictures, which solves the problem of a variable number of suture points in the images. Because there are two datasets, one from the simulated domain and the other from real intraoperative data, this work uses cycleGAN to interconvert the images from the two domains to obtain a larger dataset and a better score on real intraoperative data. This paper performed the tests using a simulated dataset of 2708 photos and a real dataset of 2376 images. The mean sensitivity on the simulated dataset is about 75.64% and the precision is about 73.62%. The mean sensitivity on the real dataset is about 50.23% and the precision is about 62.76%. The data is from the AdaptOR MICCAI Challenge 2021, which can be found at https://zenodo.org/record/4646979\#.YO1zLUxCQ2x.


title: Vortex dynamics and second magnetization peak in the iron-pnictide superconductor Ca$_{0.82}$La$_{0.18}$Fe$_{0.96}$Ni$_{0.04}$As$_2$

abstract: We report the studies of detailed magnetic relaxation and isothermal magnetization measurements in the vortex state of the 112-type iron-pnictide Ca$_{0.82}$La$_{0.18}$Fe$_{0.96}$Ni$_{0.04}$As$_2$ superconductor with $T_c$ $\sim$ 22 K. In the isothermal $M(H)$, a well defined second magnetization peak (SMP) feature is observed in the entire temperature range below $T_c$ for measurements with $H$ $\parallel$ $c$-axis. However, for $H$ $\parallel$ $ab$-planes, the SMP feature is suppressed at low temperatures, which might be due to 2D Josephson vortices forming at low temperatures and high magnetic fields in such an anisotropic system. A rigorous analysis considering the magnetic relaxation data for $H$ $\parallel$ $c$-axis suggests an elastic to plastic pinning crossover across $H_p$, which also seems accompanied with a possible phase transition in vortex lattice near $H_p$. Moreover, point disorder and surface defects are likely to be the dominant sources of pinning, which contribute to the $\delta l$-type of pinning in the sample. A high $J_c$, in access of 10$^5$ A/cm$^2$ observed could potentially make this material technologically important.


title: Development of A Load Control Algorithm to Enhance Energy Sustainability for the International Space Station

abstract: This paper presents a load control algorithm for control of energy sources and loads to enhance energy sustainability and reliability of the International Space Station (ISS), which is a large spacecraft in orbit around Earth. In this paper, the ISS electric power system was simulated in MATLAB/Simulink to be able to evaluate the performance of the developed algorithm in a simulated environment. This study also aims to emphasize the importance of load control algorithms on energy sustainability for critical systems, like ISS, having limited energy sources.


title: Large Language Models Can Be Strong Differentially Private Learners

abstract: Differentially Private (DP) learning has seen limited success for building large deep learning models of text, and straightforward attempts at applying Differentially Private Stochastic Gradient Descent (DP-SGD) to NLP tasks have resulted in large performance drops and high computational overhead. We show that this performance drop can be mitigated with (1) the use of large pretrained language models; (2) non-standard hyperparameters that suit DP optimization; and (3) fine-tuning objectives which are aligned with the pretraining procedure. With the above, we obtain NLP models that outperform state-of-the-art DP-trained models under the same privacy budget and strong non-private baselines -- by directly fine-tuning pretrained models with DP optimization on moderately-sized corpora. To address the computational challenge of running DP-SGD with large Transformers, we propose a memory saving technique that allows clipping in DP-SGD to run without instantiating per-example gradients for any linear layer in the model. The technique enables privately training Transformers with almost the same memory cost as non-private training at a modest run-time overhead. Contrary to conventional wisdom that DP optimization fails at learning high-dimensional models (due to noise that scales with dimension) empirical results reveal that private learning with pretrained language models doesn't tend to suffer from dimension-dependent performance degradation. Code to reproduce results can be found at https://github.com/lxuechen/private-transformers.


title: Event-Triggered Adaptive Control of a Parabolic PDE-ODE Cascade with Piecewise-Constant Inputs and Identification

abstract: We present an adaptive event-triggered boundary control scheme for a parabolic PDE-ODE system, where the reaction coefficient of the parabolic PDE, and the system parameter of a scalar ODE, are unknown. In the proposed controller, the parameter estimates, which are built by batch least-square identification, are recomputed and the plant states are resampled simultaneously. As a result, both the parameter estimates and the control input employ piecewise-constant values. In the closed-loop system, the following results are proved: 1) the absence of a Zeno phenomenon; 2) finite-time exact identification of the unknown parameters under most initial conditions of the plant (all initial conditions except a set of measure zero); 3) exponential regulation of the plant states to zero. A simulation example is presented to validate the theoretical result.


title: Total angular momentum representation for state-to-state quantum scattering of cold molecules in a magnetic field

abstract: We show that the integral cross sections for state-to-state quantum scattering of cold molecules in a magnetic field can be efficiently computed using the total angular momentum representation despite the presence of unphysical Zeeman states in the eigenspectrum of the asymptotic Hamiltonian. We demonstrate that the unphysical states arise due to the incompleteness of the space-fixed total angular momentum basis caused by using a fixed cutoff value $J_\text{max}$ for the total angular momentum of the collision complex $J$. As a result, certain orbital angular momentum ($l$) basis states lack the full range of $J$ values required by the angular momentum addition rules, resulting in the appearance of unphysical states. We find that by augmenting the basis with a full range of $J$-states for every $l$, it is possible to completely eliminate the unphysical states from quantum scattering calculations on molecular collisions in external fields. To illustrate the procedure, we use the augmented basis sets to calculate the state-to-state cross sections for rotational and spin relaxation in cold collisions of $^{40}$CaH$(X^2\Sigma^+,v=0,N=1, M_N=1, M_S=1/2)$ molecules with $^4$He atoms in a magnetic field. We find excellent agreement with benchmark calculations, validating our proposed procedure. We find that $N$-conserving spin relaxation to the lowest-energy Zeeman state of the $N=1$ manifold, $|11\frac{1}{2}\rangle\to |1-1-\frac{1}{2}\rangle$ is nearly completely suppressed due to the lack of spin-rotation coupling between the fully spin-stretched Zeeman states. Our results demonstrate the possibility of rigorous, computationally efficient, and unphysical state-free quantum scattering calculations on cold molecular collisions in an external magnetic field.


title: Provably Efficient Reinforcement Learning in Decentralized General-Sum Markov Games

abstract: This paper addresses the problem of learning an equilibrium efficiently in general-sum Markov games through decentralized multi-agent reinforcement learning. Given the fundamental difficulty of calculating a Nash equilibrium (NE), we instead aim at finding a coarse correlated equilibrium (CCE), a solution concept that generalizes NE by allowing possible correlations among the agents' strategies. We propose an algorithm in which each agent independently runs optimistic V-learning (a variant of Q-learning) to efficiently explore the unknown environment, while using a stabilized online mirror descent (OMD) subroutine for policy updates. We show that the agents can find an $\epsilon$-approximate CCE in at most $\widetilde{O}( H^6S A /\epsilon^2)$ episodes, where $S$ is the number of states, $A$ is the size of the largest individual action space, and $H$ is the length of an episode. This appears to be the first sample complexity result for learning in generic general-sum Markov games. Our results rely on a novel investigation of an anytime high-probability regret bound for OMD with a dynamic learning rate and weighted regret, which would be of independent interest. One key feature of our algorithm is that it is fully \emph{decentralized}, in the sense that each agent has access to only its local information, and is completely oblivious to the presence of others. This way, our algorithm can readily scale up to an arbitrary number of agents, without suffering from the exponential dependence on the number of agents.


title: Transferring quantum information between a quantum system with limited control and a quantum computer

abstract: We consider a hybrid quantum system consisting of a qubit system continuously evolving according to its fixed own Hamiltonian and a quantum computer. The qubit system couples to a quantum computer through a fixed interaction Hamiltonian, which can only be switched on and off. We present quantum algorithms to approximately transfer quantum information between the qubit system with limited control and the quantum computer under this setting. Our algorithms are programmed by the gate sequences in a closed formula for a given interface interaction Hamiltonian.


title: Rare Events via Cross-Entropy Population Monte Carlo

abstract: We present a Cross-Entropy based population Monte Carlo algorithm. This methods stands apart from previous work in that we are not optimizing a mixture distribution. Instead, we leverage deterministic mixture weights and optimize the distributions individually through a reinterpretation of the typical derivation of the cross-entropy method. Demonstrations on numerical examples show that the algorithm can outperform existing resampling population Monte Carlo methods, especially for higher-dimensional problems.


title: Spin(7)-Manifolds and Multisymplectic Geometry

abstract: We utilize Spin(7) identities to prove that the Cayley four-form associated to a torsion-free Spin(7)-Structure is non-degenerate in the sense of multisymplectic geometry. Therefore, Spin(7) geometry may be treated as a special case of multisymplectic geometry. We then capitalize on this relationship to make statements about Hamiltonian multivector fields and differential forms associated to torsion-free Spin(7)-Structures.


title: Uplink NOMA For STAR-RIS Networks

abstract: A simultaneously transmitting and reflecting reconfigurable intelligent surfaces (STAR-RISs) enhanced uplink non-orthogonal multiple access (NOMA) communication system is proposed. A total power consumption minimization problem is formulated by jointly optimizing the transmit-power of users, receive-beamforming vectors at the base station (BS), STAR-beamforming vectors at the STAR-RIS and time slots. Here, the STAR-beamforming introduced by STAR-RIS consists of transmission- and reflection-beamforming. To solve the formulated non-convex problem, an efficient penalty-based alternating optimization (P-AltOp) algorithm is proposed. Simulation results validate the effectiveness of the proposed scheme and reveal the effect of various system parameters on the total power consumption.


title: RWN: Robust Watermarking Network for Image Cropping Localization

abstract: Image cropping can be maliciously used to manipulate the layout of an image and alter the underlying meaning. Previous image crop detection schemes only predicts whether an image has been cropped, ignoring which part of the image is cropped. This paper presents a novel robust watermarking network (RWN) for image crop localization. We train an anti-crop processor (ACP) that embeds a watermark into a target image. The visually indistinguishable protected image is then posted on the social network instead of the original image. At the recipient's side, ACP extracts the watermark from the attacked image, and we conduct feature matching on the original and extracted watermark to locate the position of the crop in the original image plane. We further extend our scheme to detect tampering attack on the attacked image. Besides, we explore a simple yet efficient method (JPEG-Mixup) to improve the generalization of JPEG robustness. According to our comprehensive experiments, RWN is the first to provide high-accuracy and robust image crop localization. Besides, the accuracy of tamper detection is comparable with many state-of-the-art passive-based methods.


title: Inclusive Design: Accessibility Settings for People with Cognitive Disabilities

abstract: The advancement of technology has progressed faster than any other field in the world and with the development of these new technologies, it is important to make sure that these tools can be used by everyone, including people with disabilities. Accessibility options in computing devices help ensure that everyone has the same access to advanced technologies. Unfortunately, for those who require more unique and sometimes challenging accommodations, such as people with Amyotrophic lateral sclerosis ( ALS), the most commonly used accessibility features are simply not enough. While assistive technology for those with ALS does exist, it requires multiple peripheral devices that can become quite expensive collectively. The purpose of this paper is to suggest a more affordable and readily available option for ALS assistive technology that can be implemented on a smartphone or tablet.


title: Hiding Images into Images with Real-world Robustness

abstract: The existing image embedding networks are basically vulnerable to malicious attacks such as JPEG compression and noise adding, not applicable for real-world copyright protection tasks. To solve this problem, we introduce a generative deep network based method for hiding images into images while assuring high-quality extraction from the destructive synthesized images. An embedding network is sequentially concatenated with an attack layer, a decoupling network and an image extraction network. The addition of decoupling network learns to extract the embedded watermark from the attacked image. We also pinpoint the weaknesses of the adversarial training for robustness in previous works and build our improved real-world attack simulator. Experimental results demonstrate the superiority of the proposed method against typical digital attacks by a large margin, as well as the performance boost of the recovered images with the aid of progressive recovery strategy. Besides, we are the first to robustly hide three secret images.


title: Partial Counterfactual Identification from Observational and Experimental Data

abstract: This paper investigates the problem of bounding counterfactual queries from an arbitrary collection of observational and experimental distributions and qualitative knowledge about the underlying data-generating model represented in the form of a causal diagram. We show that all counterfactual distributions in an arbitrary structural causal model (SCM) could be generated by a canonical family of SCMs with the same causal diagram where unobserved (exogenous) variables are discrete with a finite domain. Utilizing the canonical SCMs, we translate the problem of bounding counterfactuals into that of polynomial programming whose solution provides optimal bounds for the counterfactual query. Solving such polynomial programs is in general computationally expensive. We therefore develop effective Monte Carlo algorithms to approximate the optimal bounds from an arbitrary combination of observational and experimental data. Our algorithms are validated extensively on synthetic and real-world datasets.


title: Doubly-Trained Adversarial Data Augmentation for Neural Machine Translation

abstract: Neural Machine Translation (NMT) models are known to suffer from noisy inputs. To make models robust, we generate adversarial augmentation samples that attack the model and preserve the source-side semantic meaning at the same time. To generate such samples, we propose a doubly-trained architecture that pairs two NMT models of opposite translation directions with a joint loss function, which combines the target-side attack and the source-side semantic similarity constraint. The results from our experiments across three different language pairs and two evaluation metrics show that these adversarial samples improve the model robustness.


title: Meissner effect and holographic dual for the Melvin-Kerr-Newman-Taub-NUT spacetimes

abstract: We investigate correspondence between the Melvin-Kerr-Newman-Taub-NUT spacetime, and the conformal field theory. The near horizon geometry of extremal Melvin-Kerr-Newman-Taub-NUT spacetime possesses the $SL\left(2,{\mathbb R}\right)\times U\left(1\right)$ isometry, which allows one to employ the asymptotic symmetry group method, in establishing the holographic correspondence for the spacetime. We also use the alternative way of the stretched horizon method, to compute the extremal entropy of the black hole. We find perfect agreement between the results of asymptotic symmetry group and the stretched horizon methods, to establish the holography for the extremal Melvin-Kerr-Newman-Taub-NUT black hole. The black hole Meissner effect for the Melvin-Kerr-Taub-NUT black hole is also discussed.


title: $L$-function for $\mathrm{Sp}(4)\times\mathrm{GL}(2)$ via a non-unique model

abstract: In this paper we prove a conjecture of Ginzburg and Soudry on an integral representation for the $L$-function $L^S(s, \pi\times \tau)$ attached to a pair $(\pi, \tau)$ of irreducible automorphic cuspidal representations of $\mathrm{Sp}_4({\mathbb A})$ and $\mathrm{GL}_2({\mathbb A})$, which is derived from the generalized doubling method of Cai, Friedberg, Ginzburg and Kaplan. We show that the integral unfolds to a non-unique model and analyze it using the New Way method of Piatetski-Shapiro and Rallis. As applications, we determine the poles of $L^S(s, \pi\times \tau)$ and relate the existence of the poles to the non-vanishing of certain period integrals. Moreover, for certain family of cuspidal representations $\tau$ of $\mathrm{GL}_2({\mathbb A})$, we prove that $L^S(s, \pi\times \tau)$ is holomorphic.


title: Computing Hecke operators for arithmetic subgroups of $\text{Sp}_4$

abstract: We outline an algorithm for computing Hecke operators on equivariant cohomology $H^\ast_{\Gamma_{\text{Sp}}}(X_{\text{Sp}};\rho)$ for the symplectic group $\text{Sp}_4(\mathbb{R})$. To do this, we define a new acyclic cell complex for $\text{Sp}_4(\mathbb{R})$ and make use of the well-tempered complex.


title: The Mirrornet : Learning Audio Synthesizer Controls Inspired by Sensorimotor Interaction

abstract: Experiments to understand the sensorimotor neural interactions in the human cortical speech system support the existence of a bidirectional flow of interactions between the auditory and motor regions. Their key function is to enable the brain to `learn' how to control the vocal tract for speech production. This idea is the impetus for the recently proposed "MirrorNet", a constrained autoencoder architecture. In this paper, the MirrorNet is applied to learn, in an unsupervised manner, the controls of a specific audio synthesizer (DIVA) to produce melodies only from their auditory spectrograms. The results demonstrate how the MirrorNet discovers the synthesizer parameters to generate the melodies that closely resemble the original and those of unseen melodies, and even determine the best set parameters to approximate renditions of complex piano melodies generated by a different synthesizer. This generalizability of the MirrorNet illustrates its potential to discover from sensory data the controls of arbitrary motor-plants.


title: Poisson summation for Hankel transforms

abstract: In this article we study the Poisson summation for Hankel transform in the sense of Braverman-Kazhdan-Ngo in the special case of $L$-embedding $\rho: GL_1\rightarrow GL_2$. We view such a summation formula as the generalization of the classical Voronoi summation formula.


title: Hierarchical Modeling for Task Recognition and Action Segmentation in Weakly-Labeled Instructional Videos

abstract: This paper focuses on task recognition and action segmentation in weakly-labeled instructional videos, where only the ordered sequence of video-level actions is available during training. We propose a two-stream framework, which exploits semantic and temporal hierarchies to recognize top-level tasks in instructional videos. Further, we present a novel top-down weakly-supervised action segmentation approach, where the predicted task is used to constrain the inference of fine-grained action sequences. Experimental results on the popular Breakfast and Cooking 2 datasets show that our two-stream hierarchical task modeling significantly outperforms existing methods in top-level task recognition for all datasets and metrics. Additionally, using our task recognition framework in the proposed top-down action segmentation approach consistently improves the state of the art, while also reducing segmentation inference time by 80-90 percent.


title: Observation of optical gyromagnetic properties in a magneto-plasmonic metamaterial

abstract: Metamaterials with artificial optical properties have attracted significant research interest. In particular, artificial magnetic resonances in non-unity permeability tensor at optical frequencies in metamaterials have been reported. However, only non-unity diagonal elements of the permeability tensor have been demonstrated to date. A gyromagnetic permeability tensor with non-zero off-diagonal elements has not been observed at the optical frequencies. Here we report the observation of gyromagnetic properties in the near-infrared wavelength range in a magneto-plasmonic metamaterial. The non-zero off-diagonal permeability tensor element causes the transverse magneto-optical Kerr effect (TMOKE) under s-polarized incidence that otherwise vanishes if the permeability tensor is not gyromagnetic. By retrieving the permeability tensor elements from reflection, transmission, and TMOKE spectra, we show that the effective off-diagonal permeability tensor elements reach the 10-3 level at the resonance wavelength (~900 nm) of the split-ring resonators that is at least two orders of magnitude higher than that of magneto-optical materials at the same wavelength. The artificial gyromagnetic permeability is attributed to the change in the local electric field direction modulated by the split-ring resonators. Our study demonstrates the possibility of engineering the permeability and permittivity tensors in metamaterials at arbitrary frequencies, thereby promising a variety of applications of next-generation nonreciprocal photonic devices, magneto-plasmonic sensors, and active metamaterials.


title: On Releasing Annotator-Level Labels and Information in Datasets

abstract: A common practice in building NLP datasets, especially using crowd-sourced annotations, involves obtaining multiple annotator judgements on the same data instances, which are then flattened to produce a single "ground truth" label or score, through majority voting, averaging, or adjudication. While these approaches may be appropriate in certain annotation tasks, such aggregations overlook the socially constructed nature of human perceptions that annotations for relatively more subjective tasks are meant to capture. In particular, systematic disagreements between annotators owing to their socio-cultural backgrounds and/or lived experiences are often obfuscated through such aggregations. In this paper, we empirically demonstrate that label aggregation may introduce representational biases of individual and group perspectives. Based on this finding, we propose a set of recommendations for increased utility and transparency of datasets for downstream use cases.


title: On Exploring and Improving Robustness of Scene Text Detection Models

abstract: It is crucial to understand the robustness of text detection models with regard to extensive corruptions, since scene text detection techniques have many practical applications. For systematically exploring this problem, we propose two datasets from which to evaluate scene text detection models: ICDAR2015-C (IC15-C) and CTW1500-C (CTW-C). Our study extends the investigation of the performance and robustness of the proposed region proposal, regression and segmentation-based scene text detection frameworks. Furthermore, we perform a robustness analysis of six key components: pre-training data, backbone, feature fusion module, multi-scale predictions, representation of text instances and loss function. Finally, we present a simple yet effective data-based method to destroy the smoothness of text regions by merging background and foreground, which can significantly increase the robustness of different text detection networks. We hope that this study will provide valid data points as well as experience for future research. Benchmark, code and data will be made available at \url{https://github.com/wushilian/robust-scene-text-detection-benchmark}.


title: Orthogonal Trace-Sum Maximization: Tightness of the Semidefinite Relaxation and Guarantee of Locally Optimal Solutions

abstract: This paper studies an optimization problem on the sum of traces of matrix quadratic forms in $m$ semi-orthogonal matrices, which can be considered as a generalization of the synchronization of rotations. While the problem is nonconvex, the paper shows that its semidefinite programming relaxation solves the original nonconvex problems exactly with high probability, under an additive noise model with small noise in the order of $O(m^{1/4})$. In addition, it shows that the solution of a nonconvex algorithm considered in Won, Zhou, and Lange [SIAM J. Matrix Anal. Appl., 2 (2021), pp. 859-882] is also its global solution with high probability under similar conditions. These results can be considered as a generalization of existing results on phase synchronization.


title: Auditing Robot Learning for Safety and Compliance during Deployment

abstract: Robots of the future are going to exhibit increasingly human-like and super-human intelligence in a myriad of different tasks. They are also likely going to fail and be incompliant with human preferences in increasingly subtle ways. Towards the goal of achieving autonomous robots, the robot learning community has made rapid strides in applying machine learning techniques to train robots through data and interaction. This makes the study of how best to audit these algorithms for checking their compatibility with humans, pertinent and urgent. In this paper, we draw inspiration from the AI Safety and Alignment communities and make the case that we need to urgently consider ways in which we can best audit our robot learning algorithms to check for failure modes, and ensure that when operating autonomously, they are indeed behaving in ways that the human algorithm designers intend them to. We believe that this is a challenging problem that will require efforts from the entire robot learning community, and do not attempt to provide a concrete framework for auditing. Instead, we outline high-level guidance and a possible approach towards formulating this framework which we hope will serve as a useful starting point for thinking about auditing in the context of robot learning.


title: Polarization-Orthogonal Nondegenerate Plasmonic Higher-Order Topological States

abstract: Photonic topological states, providing light-manipulation approaches in robust manners, have attracted intense attention. Connecting photonic topological states with far-field degrees of freedom(DoFs) has given rise to fruitful phenomena. Recently emerged higher-order topological insulators (HOTIs), hosting boundary states two or more dimensions lower than those of bulk, offer new paradigms to localize/transport light topologically in extended dimensionalities. However, photonic HOTIs have not been related to DoFs of radiation fields yet. Here, we report the observation of polarization-orthogonal second-order topological corner states at different frequencies on a designer-plasmonic Kagome metasurface in the far field.Such phenomenon stands on two mechanisms, i.e., projecting the far-field polarizations to the intrinsic parity DoFs of lattice modes and the parity splitting of the plasmonic corner states in spectra. We theoretically and numerically show that the parity splitting originates from the underlying inter-orbital coupling. Both near-field and far-field experiments verify the polarization-orthogonal nondegeneratesecond-order topological corner states. These results promise applications in robust optical single photon emitters and multiplexed photonic devices.


title: Ultrafast, low-energy, all-optical switch in polariton waveguides

abstract: The requirement for optical-electrical-optical conversion of signals in optical technologies is often one of the majors bottleneck in terms of speed and energy consumption. The use of dressed photons (also called polaritons), that allows for intrinsic sizable interactions, could significantly improve the performances of optical integrated elements such as switches or optical gates. In this work we demonstrate the ultrafast switch of a laser coupled into a polaritonic waveguide triggered by an optical pulse resonant with the same dispersion but at a lower energy. Our experiments show two effects capable to interrupt the transmission of the laser in two different time ranges: a sub-picosecond time range due to the optical Stark effect, and a picosecond range governed by the creation of a charge reservoir. In the latter regime we found that at certain power of excitation the activation of dark states allows for a long persistence of the switching much beyond the bright exciton lifetime.

categories: physics.optics cond-mat.mes-hall cond-mat.mtrl-sci quant-ph


title: Generalization of Poincar\'e recurrence theorem for flows on surfaces and characterization of minimal flows on compact surfaces

abstract: Poincar\'e recurrence theorem implies the density of recurrent points for volume-preserving dynamical systems on compact domains. The density of closed orbits in the non-wandering set is one of the essential properties of Axiom A and chaos. The minimal flows are one of the most fundamental objects in topological dynamics. To analyze minimality, recurrence, and density in this paper, we introduce a strict limit circuit and a circuit with wandering holonomy. Using these concepts, we classify non-recurrent non-wandering orbits of flows on compact surfaces with finitely many singular points, characterize the minimality of flows on compact surfaces, and generalize the Poincar\'e recurrence theorem for flows on surfaces. Moreover, we characterize the density of closed orbits in the non-wandering set under finiteness of singular points. Furthermore, we demonstrate the necessity of finiteness of singular points and compactness of surfaces. In addition, the analogous results hold for flows with finitely many connected components of the singular point set on non-compact surfaces using the end compactification and collapsing singular points.


title: Deep Fusion Prior for Plenoptic Super-Resolution All-in-Focus Imaging

abstract: Multi-focus image fusion (MFIF) and super-resolution (SR) are the inverse problem of imaging model, purposes of MFIF and SR are obtaining all-in-focus and high-resolution 2D mapping of targets. Though various MFIF and SR methods have been designed; almost all the them deal with MFIF and SR separately. This paper unifies MFIF and SR problems in the physical perspective as the multi-focus image super resolution fusion (MFISRF), and we propose a novel unified dataset-free unsupervised framework named deep fusion prior (DFP) based-on deep image prior (DIP) to address such MFISRF with single model. Experiments have proved that our proposed DFP approaches or even outperforms those state-of-art MFIF and SR method combinations. To our best knowledge, our proposed work is a dataset-free unsupervised method to simultaneously implement the multi-focus fusion and super-resolution task for the first time. Additionally, DFP is a general framework, thus its networks and focus measurement tactics can be continuously updated to further improve the MFISRF performance. DFP codes are open source available at http://github.com/GuYuanjie/DeepFusionPrior.


title: On Improving Model-Free Algorithms for Decentralized Multi-Agent Reinforcement Learning

abstract: Multi-agent reinforcement learning (MARL) algorithms often suffer from an exponential sample complexity dependence on the number of agents, a phenomenon known as \emph{the curse of multiagents}. In this paper, we address this challenge by investigating sample-efficient model-free algorithms in \emph{decentralized} MARL, and aim to improve existing algorithms along this line. For learning (coarse) correlated equilibria in general-sum Markov games, we propose \emph{stage-based} V-learning algorithms that significantly simplify the algorithmic design and analysis of recent works, and circumvent a rather complicated no-\emph{weighted}-regret bandit subroutine. For learning Nash equilibria in Markov potential games, we propose an independent policy gradient algorithm with a decentralized momentum-based variance reduction technique. All our algorithms are decentralized in that each agent can make decisions based on only its local information. Neither communication nor centralized coordination is required during learning, leading to a natural generalization to a large number of agents. We also provide numerical simulations to corroborate our theoretical findings.


title: Nearly optimal quantum algorithm for generating the ground state of a free quantum field theory

abstract: We devise a quasilinear quantum algorithm for generating an approximation for the ground state of a quantum field theory (QFT). Our quantum algorithm delivers a super-quadratic speedup over the state-of-the-art quantum algorithm for ground-state generation, overcomes the ground-state-generation bottleneck of the prior approach and is optimal up to a polylogarithmic factor. Specifically, we establish two quantum algorithms -- Fourier-based and wavelet-based -- to generate the ground state of a free massive scalar bosonic QFT with gate complexity quasilinear in the number of discretized-QFT modes. The Fourier-based algorithm is limited to translationally invariant QFTs. Numerical simulations show that the wavelet-based algorithm successfully yields the ground state for a QFT with broken translational invariance. Furthermore, the cost of preparing particle excitations in the wavelet approach is independent of the energy scale. Our algorithms require a routine for generating one-dimensional Gaussian (1DG) states. We replace the standard method for 1DG-state generation, which requires the quantum computer to perform lots of costly arithmetic, with a novel method based on inequality testing that significantly reduces the need for arithmetic. Our method for 1DG-state generation is generic and could be extended to preparing states whose amplitudes can be computed on the fly by a quantum computer.


title: Mixed Generalized Multiscale Finite Element Method for Flow Problem in Thin Domains

abstract: In this paper, we construct a class of Mixed Generalized Multiscale Finite Element Methods for the approximation on a coarse grid for an elliptic problem in thin two-dimensional domains. We consider the elliptic equation with homogeneous boundary conditions on the domain walls. For reference solution of the problem, we use a Mixed Finite Element Method on a fine grid that resolves complex geometry on the grid level. To construct a lower dimensional model, we use the Mixed Generalized Multiscale Finite Element Method, which is based on some multiscale basis functions for velocity fields. The construction of the basis functions is based on the local snapshot space that takes all possible flows on the interface between coarse cells into account. In order to reduce the size of the snapshot space and obtain the multiscale approximation, we solve a local spectral problem to identify dominant modes in the snapshot space. We present a convergence analysis of the presented multiscale method. Numerical results are presented for two-dimensional problems in three testing geometries along with the errors associated to different numbers of the multiscale basis functions used for the velocity field. Numerical investigations are conducted for problems with homogeneous and heterogeneous properties respectively.


title: Symmetry-Protected Infinite-Temperature Quantum Memory from Subsystem Codes

abstract: We study a mechanism whereby quantum information present in the initial state of a quantum many-body system can be protected for arbitrary times due to a combination of symmetry and spatial locality. Remarkably, the mechanism is sufficiently generic that the dynamics can be fully ergodic upon resolving the protecting symmetry and fixing the encoded quantum state, resulting in an infinite-temperature quantum memory. After exemplifying the mechanism in a strongly nonintegrable two-dimensional (2D) spin model inspired by the surface code, we find it has a natural interpretation in the language of noiseless subsystems and stabilizer subsystem codes. This interpretation yields a number of further examples, including a nonintegrable Hamiltonian with quantum memory based on the Bacon-Shor code. The lifetime of the encoded quantum information in these models is infinite provided the dynamics respect the stabilizer symmetry of the underlying subsystem code. In the presence of symmetry-violating perturbations, we make contact with previous work leveraging the concept of prethermalization to show that the encoded quantum information retains a parametrically long lifetime under dynamics with an enlarged continuous symmetry group. We identify conditions on the underlying subsystem code that enable such a prethermal enhancement of the memory lifetime.


title: Weight two compactly supported cohomology of moduli spaces of curves

abstract: We study the weight 2 graded piece of the compactly supported rational cohomology of the moduli spaces of curves $M_{g,n}$ and show that this can be computed as the cohomology of a graph complex that is closely related to graph complexes arising in the study of embedding spaces. For $n = 0$, we express this cohomology in terms of the weight zero compactly supported cohomology of $M_{g',n'}$ for $g' \leq g$ and $n' \leq 2$, and thereby produce several new infinite families of nonvanishing unstable cohomology groups on $M_g$, including the first such families in odd degrees. In particular, we show that the dimension of $H^{4g-k}(M_g)$ grows at least exponentially with $g$, for $k \in \{ 8, 9, 11, 12, 14, 15, 16, 18, 19 \}$.


title: DecGAN: Decoupling Generative Adversarial Network detecting abnormal neural circuits for Alzheimer's disease

abstract: One of the main reasons for Alzheimer's disease (AD) is the disorder of some neural circuits. Existing methods for AD prediction have achieved great success, however, detecting abnormal neural circuits from the perspective of brain networks is still a big challenge. In this work, a novel decoupling generative adversarial network (DecGAN) is proposed to detect abnormal neural circuits for AD. Concretely, a decoupling module is designed to decompose a brain network into two parts: one part is composed of a few sparse graphs which represent the neural circuits largely determining the development of AD; the other part is a supplement graph, whose influence on AD can be ignored. Furthermore, the adversarial strategy is utilized to guide the decoupling module to extract the feature more related to AD. Meanwhile, by encoding the detected neural circuits to hypergraph data, an analytic module associated with the hyperedge neurons algorithm is designed to identify the neural circuits. More importantly, a novel sparse capacity loss based on the spatial-spectral hypergraph similarity is developed to minimize the intrinsic topological distribution of neural circuits, which can significantly improve the accuracy and robustness of the proposed model. Experimental results demonstrate that the proposed model can effectively detect the abnormal neural circuits at different stages of AD, which is helpful for pathological study and early treatment.


title: Foster Strengths and Circumvent Weaknesses: a Speech Enhancement Framework with Two-branch Collaborative Learning

abstract: Recent single-channel speech enhancement methods usually convert waveform to the time-frequency domain and use magnitude/complex spectrum as the optimizing target. However, both magnitude-spectrum-based methods and complex-spectrum-based methods have their respective pros and cons. In this paper, we propose a unified two-branch framework to foster strengths and circumvent weaknesses of different paradigms. The proposed framework could take full advantage of the apparent spectral regularity in magnitude spectrogram and break the bottleneck that magnitude-based methods have suffered. Within each branch, we use collaborative expert block and its variants as substitutes for regular convolution layers. Experiments on TIMIT benchmark demonstrate that our method is superior to existing state-of-the-art ones.


title: Simple restricted modules over the Heisenberg-Virasoro algebra as VOA modules

abstract: In this paper, we determine all simple restricted modules over the mirror Heisenberg-Virasoro algebra ${\mathfrak{D}}$, and the twisted Heisenberg-Virasoro algebra $\bar\mathfrak{D}$ with nonzero level. As applications, we characterize simple Whittaker modules and simple highest weight modules over ${\mathfrak{D}}$. A vertex-algebraic interpretation of our result is the classification of simple weak twisted and untwisted modules over the Heisenberg-Virasoro vertex operator algebras $\mathcal V^{c} \cong V_{Vir}^{c}\otimes M(1)$. We also present a few examples of simple restricted ${\mathfrak{D}}$-modules and $\bar\mathfrak{D}$-modules induced from simple modules over finite dimensional solvable Lie algebras, that are not tensor product modules of Virasoro modules and Heisenberg modules. This is very different from the case of simple highest weight modules over $\mathfrak{D}$ and $\bar\mathfrak{D}$ which are always tensor products of simple Virasoro modules and simple Heisenberg modules.


title: Joint 3-D Positioning and Power Allocation for UAV Relay Aided by Geographic Information

abstract: In this paper, we study to employ geographic information to address the blockage problem of air-to-ground links between UAV and terrestrial nodes. In particular, a UAV relay is deployed to establish communication links from a ground base station to multiple ground users. To improve communication capacity, we first model the blockage effect caused by buildings according to the three-dimensional (3-D) geographic information. Then, an optimization problem is formulated to maximize the minimum capacity among users by jointly optimizing the 3-D position and power allocation of the UAV relay, under the constraints of link capacity, maximum transmit power, and blockage. To solve this complex non-convex problem, a two-loop optimization framework is developed based on Lagrangian relaxation. The outer-loop aims to obtain proper Lagrangian multipliers to ensure the solution of the Lagrangian problem converge to the tightest upper bound on the original problem. The inner-loop solves the Lagrangian problem by applying the block coordinate descent (BCD) and successive convex approximation (SCA) techniques, where UAV 3-D positioning and power allocation are alternately optimized in each iteration. Simulation results confirm that the proposed solution significantly outperforms two benchmark schemes and achieves a performance close to the upper bound on the UAV relay system.


title: Convergence and stability of the semi-tamed Milstein method for commutative stochastic differential equations with non-globally Lipschitz continuous coefficients

abstract: A new explicit stochastic scheme of order 1 is proposed for solving commutative stochastic differential equations (SDEs) with non-globally Lipschitz continuous coefficients. The proposed method is a semi-tamed version of Milstein scheme to solve SDEs with the drift coefficient consisting of non-Lipschitz continuous term and globally Lipschitz continuous term. It is easily implementable and achieves higher strong convergence order. A stability criterion for this method is derived, which shows that the stability condition of the numerical methods and that of the solved equations keep uniform. Compared with some widely used numerical schemes, the proposed method has better performance in inheriting the mean square stability of the exact solution of SDEs. Numerical experiments are given to illustrate the obtained convergence and stability properties.


title: Relation-aware Video Reading Comprehension for Temporal Language Grounding

abstract: Temporal language grounding in videos aims to localize the temporal span relevant to the given query sentence. Previous methods treat it either as a boundary regression task or a span extraction task. This paper will formulate temporal language grounding into video reading comprehension and propose a Relation-aware Network (RaNet) to address it. This framework aims to select a video moment choice from the predefined answer set with the aid of coarse-and-fine choice-query interaction and choice-choice relation construction. A choice-query interactor is proposed to match the visual and textual information simultaneously in sentence-moment and token-moment levels, leading to a coarse-and-fine cross-modal interaction. Moreover, a novel multi-choice relation constructor is introduced by leveraging graph convolution to capture the dependencies among video moment choices for the best choice selection. Extensive experiments on ActivityNet-Captions, TACoS, and Charades-STA demonstrate the effectiveness of our solution. Codes have been available.


title: Room-temperature quantum spin Hall edge state in a higher-order topological insulator Bi$_4$Br$_4$

abstract: Room-temperature realization of macroscopic quantum phenomena is one of the major pursuits in fundamental physics. The quantum spin Hall state, a topological quantum phenomenon that features a two-dimensional insulating bulk and a helical edge state, has not yet been realized at room temperature. Here, we use scanning tunneling microscopy to visualize a quantum spin Hall edge state on the surface of the higher-order topological insulator Bi4Br4. We find that the atomically resolved lattice exhibits a large insulating gap of over 200meV, and an atomically sharp monolayer step edge hosts a striking in-gap gapless state, suggesting the topological bulk-boundary correspondence. An external magnetic field can gap the edge state, consistent with the time-reversal symmetry protection inherent to the underlying topology. We further identify the geometrical hybridization of such edge states, which not only attests to the Z2 topology of the quantum spin Hall state but also visualizes the building blocks of the higher-order topological insulator phase. Remarkably, both the insulating gap and topological edge state are observed to persist up to 300K. Our results point to the realization of the room-temperature quantum spin Hall edge state in a higher-order topological insulator.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el physics.app-ph


title: Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations

abstract: Majority voting and averaging are common approaches employed to resolve annotator disagreements and derive single ground truth labels from multiple annotations. However, annotators may systematically disagree with one another, often reflecting their individual biases and values, especially in the case of subjective tasks such as detecting affect, aggression, and hate speech. Annotator disagreements may capture important nuances in such tasks that are often ignored while aggregating annotations to a single ground truth. In order to address this, we investigate the efficacy of multi-annotator models. In particular, our multi-task based approach treats predicting each annotators' judgements as separate subtasks, while sharing a common learned representation of the task. We show that this approach yields same or better performance than aggregating labels in the data prior to training across seven different binary classification tasks. Our approach also provides a way to estimate uncertainty in predictions, which we demonstrate better correlate with annotation disagreements than traditional methods. Being able to model uncertainty is especially useful in deployment scenarios where knowing when not to make a prediction is important.


title: A Burden Shared is a Burden Halved: A Fairness-Adjusted Approach to Classification

abstract: We investigate the fairness issue in classification, where automated decisions are made for individuals from different protected groups. In high-consequence scenarios, decision errors can disproportionately affect certain protected groups, leading to unfair outcomes. To address this issue, we propose a fairness-adjusted selective inference (FASI) framework and develop data-driven algorithms that achieve statistical parity by controlling the false selection rate (FSR) among protected groups. Our FASI algorithm operates by converting the outputs of black-box classifiers into R-values, which are both intuitive and computationally efficient. These R-values serve as the basis for selection rules that are provably valid for FSR control in finite samples for protected groups, effectively mitigating the unfairness in group-wise error rates. We demonstrate the numerical performance of our approach using both simulated and real data.


title: Action-Sufficient State Representation Learning for Control with Structural Constraints

abstract: Perceived signals in real-world scenarios are usually high-dimensional and noisy, and finding and using their representation that contains essential and sufficient information required by downstream decision-making tasks will help improve computational efficiency and generalization ability in the tasks. In this paper, we focus on partially observable environments and propose to learn a minimal set of state representations that capture sufficient information for decision-making, termed \textit{Action-Sufficient state Representations} (ASRs). We build a generative environment model for the structural relationships among variables in the system and present a principled way to characterize ASRs based on structural constraints and the goal of maximizing cumulative reward in policy learning. We then develop a structured sequential Variational Auto-Encoder to estimate the environment model and extract ASRs. Our empirical results on CarRacing and VizDoom demonstrate a clear advantage of learning and using ASRs for policy learning. Moreover, the estimated environment model and ASRs allow learning behaviors from imagined outcomes in the compact latent space to improve sample efficiency.


title: LightSeq2: Accelerated Training for Transformer-based Models on GPUs

abstract: Transformer-based neural models are used in many AI applications. Training these models is expensive, as it takes huge GPU resources and long duration. It is challenging because typical data like sentences have variable lengths, and Transformer's computation patterns are more complex than convolutional neural networks. Existing systems either only focus on model inference or optimization for only BERT-like encoder models. In this paper, we present LightSeq2, a system to accelerate training for a general family of Transformer models on GPUs. We propose a series of GPU optimization techniques tailored to the specific computation flow and memory access patterns of Transformer models. LightSeq2 supports many model architectures, including BERT (encoder-only), GPT (decoder-only), Transformer (encoder-decoder), and vision Transformer. Our experiments for a variety of models and benchmarks show that LightSeq2 is consistently faster (1.4-3.5x) than previous systems on different GPUs. In particular, it gains 308% training speedup compared with existing systems on a large public machine translation benchmark (WMT14 English-German).


title: Prediction of Political Leanings of Chinese Speaking Twitter Users

abstract: This work presents a supervised method for generating a classifier model of the stances held by Chinese-speaking politicians and other Twitter users. Many previous works of political tweets prediction exist on English tweets, but to the best of our knowledge, this is the first work that builds prediction model on Chinese political tweets. It firstly collects data by scraping tweets of famous political figure and their related users. It secondly defines the political spectrum in two groups: the group that shows approvals to the Chinese Communist Party and the group that does not. Since there are not space between words in Chinese to identify the independent words, it then completes segmentation and vectorization by Jieba, a Chinese segmentation tool. Finally, it trains the data collected from political tweets and produce a classification model with high accuracy for understanding users' political stances from their tweets on Twitter.


title: Query-Reward Tradeoffs in Multi-Armed Bandits

abstract: We consider a stochastic multi-armed bandit setting where reward must be actively queried for it to be observed. We provide tight lower and upper problem-dependent guarantees on both the regret and the number of queries. Interestingly, we prove that there is a fundamental difference between problems with a unique and multiple optimal arms, unlike in the standard multi-armed bandit problem. We also present a new, simple, UCB-style sampling concept, and show that it naturally adapts to the number of optimal arms and achieves tight regret and querying bounds.


title: Thermodynamic contacts and breathing mode physics of 1D p-wave Fermi gases in the high temperature limit

abstract: An important tool for understanding the effects of interactions in harmonically trapped atomic gases is the examination of their collective modes. One such mode is the breathing or monopole mode, which is special as it is constrained to occur at twice the harmonic trapping frequency when the interactions are scale invariant. When the interactions are not scale invariant, the frequency of the breathing mode will deviate from twice the trap frequency. The deviation itself depends on the thermodynamic contacts, which describe how the energy changes with the interactions. In this work I examine how the thermodynamic contacts and the breathing mode frequency of a spin-polarized one-dimensional (1D) p-wave Fermi gas depend on the 1D scattering volume, $\ell$, and the effective range, $r$, in the high temperature limit. Such dynamics can be studied in experiments and provide a tool for understanding how the dynamics depend on interactions with a finite effective range.


title: Estimation of Photometric Redshifts. I. Machine Learning Inference for Pan-STARRS1 Galaxies Using Neural Networks

abstract: We present a new machine learning model for estimating photometric redshifts with improved accuracy for galaxies in Pan-STARRS1 data release 1. Depending on the estimation range of redshifts, this model based on neural networks can handle the difficulty for inferring photometric redshifts. Moreover, to reduce bias induced by the new model's ability to deal with estimation difficulty, it exploits the power of ensemble learning. We extensively examine the mapping between input features and target redshift spaces to which the model is validly applicable to discover the strength and weaknesses of trained model. Because our trained model is well calibrated, our model produces reliable confidence information about objects with non-catastrophic estimation. While our model is highly accurate for most test examples residing in the input space, where training samples are densely populated, its accuracy quickly diminishes for sparse samples and unobserved objects (i.e., unseen samples) in training. We report that out-of-distribution (OOD) samples for our model contain both physically OOD objects (i.e., stars and quasars) and galaxies with observed properties not represented by training data. The code for our model is available at https://github.com/GooLee0123/MBRNN for other uses of the model and retraining the model with different data.


title: Anatomy of OntoGUM--Adapting GUM to the OntoNotes Scheme to Evaluate Robustness of SOTA Coreference Algorithms

abstract: SOTA coreference resolution produces increasingly impressive scores on the OntoNotes benchmark. However lack of comparable data following the same scheme for more genres makes it difficult to evaluate generalizability to open domain data. Zhu et al. (2021) introduced the creation of the OntoGUM corpus for evaluating geralizability of the latest neural LM-based end-to-end systems. This paper covers details of the mapping process which is a set of deterministic rules applied to the rich syntactic and discourse annotations manually annotated in the GUM corpus. Out-of-domain evaluation across 12 genres shows nearly 15-20% degradation for both deterministic and deep learning systems, indicating a lack of generalizability or covert overfitting in existing coreference resolution models.


title: Rethinking the Spatial Route Prior in Vision-and-Language Navigation

abstract: Vision-and-language navigation (VLN) is a trending topic which aims to navigate an intelligent agent to an expected position through natural language instructions. This work addresses the task of VLN from a previously-ignored aspect, namely the spatial route prior of the navigation scenes. A critically enabling innovation of this work is explicitly considering the spatial route prior under several different VLN settings. In a most information-rich case of knowing environment maps and admitting shortest-path prior, we observe that given an origin-destination node pair, the internal route can be uniquely determined. Thus, VLN can be effectively formulated as an ordinary classification problem over all possible destination nodes in the scenes. Furthermore, we relax it to other more general VLN settings, proposing a sequential-decision variant (by abandoning the shortest-path route prior) and an explore-and-exploit scheme (for addressing the case of not knowing the environment maps) that curates a compact and informative sub-graph to exploit. As reported by [34], the performance of VLN methods has been stuck at a plateau in past two years. Even with increased model complexity, the state-of-the-art success rate on R2R validation-unseen set has stayed around 62% for single-run and 73% for beam-search with model-ensemble. We have conducted comprehensive evaluations on both R2R and R4R, and surprisingly found that utilizing the spatial route priors may be the key of breaking above-mentioned performance ceiling. For example, on R2R validation-unseen set, when the number of discrete nodes explored is about 40, our single-model success rate reaches 73%, and increases to 78% if a Speaker model is ensembled, which significantly outstrips previous state-of-the-art VLN-BERT with 3 models ensembled.


title: Steering of beam trajectory by distorted photonic crystals

abstract: Electromagnetic waves follow linear paths in homogenous index media, with the exception of band edges. In this study, we introduced spatially distorted photonic crystals (D-PCs) that are capable of beam-steering light waves, even when a homogeneous refractive index is maintained. We analyzed their equifrequency contours to investigate the correspondence between the direction of distortion and the direction of the group velocity vector in the D-PC. Thereafter, we experimentally verified the beam-steering phenomenon in the terahertz range using an all-silicon D-PC. Our structures serve as on-chip beam trajectory control without the need for any specially-engineered materials, using only lattice distortion.


title: Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation

abstract: Recent advancements of sequential deep learning models such as Transformer and BERT have significantly facilitated the sequential recommendation. However, according to our study, the distribution of item embeddings generated by these models tends to degenerate into an anisotropic shape, which may result in high semantic similarities among embeddings. In this paper, both empirical and theoretical investigations of this representation degeneration problem are first provided, based on which a novel recommender model DuoRec is proposed to improve the item embeddings distribution. Specifically, in light of the uniformity property of contrastive learning, a contrastive regularization is designed for DuoRec to reshape the distribution of sequence representations. Given the convention that the recommendation task is performed by measuring the similarity between sequence representations and item embeddings in the same space via dot product, the regularization can be implicitly applied to the item embedding distribution. Existing contrastive learning methods mainly rely on data level augmentation for user-item interaction sequences through item cropping, masking, or reordering and can hardly provide semantically consistent augmentation samples. In DuoRec, a model-level augmentation is proposed based on Dropout to enable better semantic preserving. Furthermore, a novel sampling strategy is developed, where sequences having the same target item are chosen hard positive samples. Extensive experiments conducted on five datasets demonstrate the superior performance of the proposed DuoRec model compared with baseline methods. Visualization results of the learned representations validate that DuoRec can largely alleviate the representation degeneration problem.


title: Topic Scene Graph Generation by Attention Distillation from Caption

abstract: If an image tells a story, the image caption is the briefest narrator. Generally, a scene graph prefers to be an omniscient generalist, while the image caption is more willing to be a specialist, which outlines the gist. Lots of previous studies have found that a scene graph is not as practical as expected unless it can reduce the trivial contents and noises. In this respect, the image caption is a good tutor. To this end, we let the scene graph borrow the ability from the image caption so that it can be a specialist on the basis of remaining all-around, resulting in the so-called Topic Scene Graph. What an image caption pays attention to is distilled and passed to the scene graph for estimating the importance of partial objects, relationships, and events. Specifically, during the caption generation, the attention about individual objects in each time step is collected, pooled, and assembled to obtain the attention about relationships, which serves as weak supervision for regularizing the estimated importance scores of relationships. In addition, as this attention distillation process provides an opportunity for combining the generation of image caption and scene graph together, we further transform the scene graph into linguistic form with rich and free-form expressions by sharing a single generation model with image caption. Experiments show that attention distillation brings significant improvements in mining important relationships without strong supervision, and the topic scene graph shows great potential in subsequent applications.


title: Guided-GAN: Adversarial Representation Learning for Activity Recognition with Wearables

abstract: Human activity recognition (HAR) is an important research field in ubiquitous computing where the acquisition of large-scale labeled sensor data is tedious, labor-intensive and time consuming. State-of-the-art unsupervised remedies investigated to alleviate the burdens of data annotations in HAR mainly explore training autoencoder frameworks. In this paper: we explore generative adversarial network (GAN) paradigms to learn unsupervised feature representations from wearable sensor data; and design a new GAN framework-Geometrically-Guided GAN or Guided-GAN-for the task. To demonstrate the effectiveness of our formulation, we evaluate the features learned by Guided-GAN in an unsupervised manner on three downstream classification benchmarks. Our results demonstrate Guided-GAN to outperform existing unsupervised approaches whilst closely approaching the performance with fully supervised learned representations. The proposed approach paves the way to bridge the gap between unsupervised and supervised human activity recognition whilst helping to reduce the cost of human data annotation tasks.


title: New generalization of the simplest $\alpha$-attractor $T$ model

abstract: The simplest $\alpha$-attractor $T$ model is given by the potential $V=V_0\tanh^2(\lambda\phi/M_{pl})$. However its generalization to the class of models of the type $V = V_0 \tanh^p (\lambda \phi/M_{pl})$ is difficult to interpret as a model of inflation for most values of $p$. Keeping the basic model, we propose a new generalization, where the final potential is of the form $V = V_0 (1-\sech^p (\lambda \phi/M_{pl}))$, which does not present any of the problems that plague the original generalization, allowing a successful interpretation as a model of inflation for any value of $p$ and, at the same time, providing the potential with a region where reheating can occur for any $p$ (including odd and fractional values) without difficulty. In the cases $p = 1, 2, 4$ we obtain the solutions $r(n_s, N_{ke})$ where $r$ is the tensor-to-scalar ratio, $n_s$ the spectral index and $N_{ke}$ the number of $e$-folds during inflation. We also show how these solutions connect to the $\phi^2$ monomial.


title: Learning Efficient Multi-Agent Cooperative Visual Exploration

abstract: We tackle the problem of cooperative visual exploration where multiple agents need to jointly explore unseen regions as fast as possible based on visual signals. Classical planning-based methods often suffer from expensive computation overhead at each step and a limited expressiveness of complex cooperation strategy. By contrast, reinforcement learning (RL) has recently become a popular paradigm for tackling this challenge due to its modeling capability of arbitrarily complex strategies and minimal inference overhead. In this paper, we extend the state-of-the-art single-agent visual navigation method, Active Neural SLAM (ANS), to the multi-agent setting by introducing a novel RL-based planning module, Multi-agent Spatial Planner (MSP).MSP leverages a transformer-based architecture, Spatial-TeamFormer, which effectively captures spatial relations and intra-agent interactions via hierarchical spatial self-attentions. In addition, we also implement a few multi-agent enhancements to process local information from each agent for an aligned spatial representation and more precise planning. Finally, we perform policy distillation to extract a meta policy to significantly improve the generalization capability of final policy. We call this overall solution, Multi-Agent Active Neural SLAM (MAANS). MAANS substantially outperforms classical planning-based baselines for the first time in a photo-realistic 3D simulator, Habitat. Code and videos can be found at https://sites.google.com/view/maans.


title: Global games with Poisson observations: Bio-inspired distributed coordination of multi-agent systems

abstract: Global games are a class of incomplete information games where the payoffs exhibit strategic complementarity leading to an incentive for the agents to coordinate their actions. Such games have been used to model scenarios in many socioeconomic phenomena, where the private signals available to the agents are typically assumed to be Gaussian. We study an instance of a global game where the agents observe Poisson random variables, which are inspired by applications in microbiology where information signals are disseminated via discrete molecular signals rather than continuous. Although this observation model violates the essential technical assumptions present in the Gaussian case, we present preliminary results on the existence of Bayesian Nash equilibria in pure threshold policies in two variants of the underlying random state-of-the-world: an arbitrarily distributed discrete binary state and a continuous state with uniform distribution.


title: Exact ground state and elementary excitations of a competing spin chain with twisted boundary condition

abstract: A novel Bethe ansatz scheme is proposed to investigate the exact physical properties of an integrable anisotropic quantum spin chain with competing interactions among the nearest, next nearest neighbor and chiral three spin couplings, where the boundary condition is the twisted one. The eigenvalue of the transfer matrix is characterized by its zero roots instead of the traditional Bethe roots. Based on the exact solution, the conserved momentum and charge operators of this U(1)-symmetry broken system are obtained. The ground state energy and density of rapidities are calculated. It is found that there exist three kinds of elementary excitations and the corresponding dispersion relations are obtained, which gives a different picture from that with periodic boundary condition.


title: Quantum harmonic oscillators and thermalization

abstract: We study a quantum harmonic oscillator undergoing thermalization. To describe the thermalization process, we generalize the Ermakov-Lewis-Riesenfeld (ELR) invariant method for the oscillator. After imposing appropriate conditions on the thermalization process, we introduce an ansatz equation that describes the time evolution effectively. We write down the first law for thermalization in the same form as that for ordinary thermodynamics. Here, the thermalization effect appears through a change of the ELR frequency. Finally, we obtain the oscillator's energy undergoing thermalization as a function of entropy and its time derivative.


title: High-mobility field-effect transistor using 2-dimensional electron gas at the LaScO3/BaSnO3 interface

abstract: A novel 2-dimensional electron gas (2DEG) system with high-mobility was discovered at the interface of two perovskite oxides, a polar orthorhombic perovskite LaScO3 (LSO) and a nonpolar cubic perovskite BaSnO3 (BSO). Upon depositing the LSO film on the BSO film, the conductance enhancement and the resulting 2DEG density (n2D) was measured. Comparing the results with the previously reported LaInO3/BaSnO3 (LIO/BSO) polar interface, we applied the interface polarization model to the LSO/BSO system, in which the polarization exists only over 4 pseudocubic unit cells in LSO from the interface and vanishes afterward like the LIO/BSO interface. Based on the calculations of the self-consistent Poisson-Schrodinger equations, the LSO thickness dependence of n2D of LSO/BSO heterointerface is consistent with this model. Furthermore, a single subband in the quantum well is predicted. Using the conductive interface and the LSO as a gate dielectric, a 2DEG transistor composed of only perovskite oxides with high field-effect mobility (uFE) close to 100 cm2 V-1 s-1 is demonstrated.


title: Modeling Polarization Signals from Cloudy Brown Dwarfs: Luhman 16 A and B in Three Dimensions

abstract: The detection of disk-integrated polarization from Luhman 16A and B in H-band, and subsequent modeling, has been interpreted in the framework of zonal cloud bands on these bodies. Recently, Tan and Showman (2021) investigated three-dimensional atmospheric circulation and cloud structures of brown dwarfs with general circulation models (GCMs), and their simulations yield complex cloud distributions showing some aspects of zonal jets, but also complex vortices that cannot be captured by a simple model. Here we use these 3D GCMs specific to Luhman 16A and B, along with the three-dimensional Monte Carlo radiative transfer code ARTES, to calculate their polarization signals. We adopt the 3D temperature-pressure and cloud profiles from the GCMs as our input atmospheric structures. Our polarization calculations at 1.6 $\mu$m agree well with the measured degree of linear polarization from both Luhman 16 A and B. Our calculations reproduce the measured polarization for both the objects with cloud particle sizes between 0.5-1 \,$\mu$m for Luhman 16 A and 5 \,$\mu$m for Luhman 16 B. We find that the degree of linear polarization can vary on hour-long timescales over the course of a rotation period. We also show that models with azimuthally symmetric band-like cloud geometries, typically used for interpreting polarimetry observations of brown dwarfs, over-predict the polarization signal if the cloud patterns do not include complex vortices within these bands. This exploratory work shows that GCMs are promising for modeling and interpreting polarization signals of brown dwarfs.


title: Temporal Abstraction in Reinforcement Learning with the Successor Representation

abstract: Reasoning at multiple levels of temporal abstraction is one of the key attributes of intelligence. In reinforcement learning, this is often modeled through temporally extended courses of actions called options. Options allow agents to make predictions and to operate at different levels of abstraction within an environment. Nevertheless, approaches based on the options framework often start with the assumption that a reasonable set of options is known beforehand. When this is not the case, there are no definitive answers for which options one should consider. In this paper, we argue that the successor representation (SR), which encodes states based on the pattern of state visitation that follows them, can be seen as a natural substrate for the discovery and use of temporal abstractions. To support our claim, we take a big picture view of recent results, showing how the SR can be used to discover options that facilitate either temporally-extended exploration or planning. We cast these results as instantiations of a general framework for option discovery in which the agent's representation is used to identify useful options, which are then used to further improve its representation. This results in a virtuous, never-ending, cycle in which both the representation and the options are constantly refined based on each other. Beyond option discovery itself, we also discuss how the SR allows us to augment a set of options into a combinatorially large counterpart without additional learning. This is achieved through the combination of previously learned options. Our empirical evaluation focuses on options discovered for exploration and on the use of the SR to combine them. The results of our experiments shed light on important design decisions involved in the definition of options and demonstrate the synergy of different methods based on the SR, such as eigenoptions and the option keyboard.


title: Online Refinement of Low-level Feature Based Activation Map for Weakly Supervised Object Localization

abstract: We present a two-stage learning framework for weakly supervised object localization (WSOL). While most previous efforts rely on high-level feature based CAMs (Class Activation Maps), this paper proposes to localize objects using the low-level feature based activation maps. In the first stage, an activation map generator produces activation maps based on the low-level feature maps in the classifier, such that rich contextual object information is included in an online manner. In the second stage, we employ an evaluator to evaluate the activation maps predicted by the activation map generator. Based on this, we further propose a weighted entropy loss, an attentive erasing, and an area loss to drive the activation map generator to substantially reduce the uncertainty of activations between object and background, and explore less discriminative regions. Based on the low-level object information preserved in the first stage, the second stage model gradually generates a well-separated, complete, and compact activation map of object in the image, which can be easily thresholded for accurate localization. Extensive experiments on CUB-200-2011 and ImageNet-1K datasets show that our framework surpasses previous methods by a large margin, which sets a new state-of-the-art for WSOL.


title: "Galton board" nuclear hyperpolarization

abstract: We consider the problem of determining the spectrum of an electronic spin via polarization transfer to coupled nuclear spins and their subsequent readout. This suggests applications for employing dynamic nuclear polarization (DNP) for "ESR-via-NMR". In this paper, we describe the theoretical basis for this process by developing a model for the evolution dynamics of the coupled electron-nuclear system through a cascade of Landau-Zener anti-crossings (LZ-LACs). We develop a method to map these traversals to the operation of an equivalent "Galton board". Here, LZ-LAC points serve as analogues to Galton board "pegs", upon interacting with which the nuclear populations redistribute. The developed hyperpolarization then tracks the local electronic density of states. We show that this approach yields an intuitive and analytically tractable solution of the polarization transfer dynamics, including when DNP is carried out at the wing of a homogeneously broadened electronic spectral line. We apply this approach to a model system comprised of a Nitrogen Vacancy (NV) center electron in diamond, hyperfine coupled to N neighboring 13C nuclear spins, and discuss applications for nuclear-spin interrogated NV center magnetometry. More broadly, the methodology of "one-to-many" electron-to-nuclear spectral mapping developed here suggests interesting applications in quantum memories and sensing, as well as wider applications in modeling DNP processes in the multiple nuclear spin limit.


title: Program Transfer for Answering Complex Questions over Knowledge Bases

abstract: Program induction for answering complex questions over knowledge bases (KBs) aims to decompose a question into a multi-step program, whose execution against the KB produces the final answer. Learning to induce programs relies on a large number of parallel question-program pairs for the given KB. However, for most KBs, the gold program annotations are usually lacking, making learning difficult. In this paper, we propose the approach of program transfer, which aims to leverage the valuable program annotations on the rich-resourced KBs as external supervision signals to aid program induction for the low-resourced KBs that lack program annotations. For program transfer, we design a novel two-stage parsing framework with an efficient ontology-guided pruning strategy. First, a sketch parser translates the question into a high-level program sketch, which is the composition of functions. Second, given the question and sketch, an argument parser searches the detailed arguments from the KB for functions. During the searching, we incorporate the KB ontology to prune the search space. The experiments on ComplexWebQuestions and WebQuestionSP show that our method outperforms SOTA methods significantly, demonstrating the effectiveness of program transfer and our framework. Our codes and datasets can be obtained from https://github.com/THU-KEG/ProgramTransfer.


title: Fast X-ray spectrum and image acquisition method for the XFEL facility

abstract: X-ray free electron laser (XFEL) can provide X-ray light with about four order of magnitude higher flux than synchrotron radiation. Pulse light from XFEL interacts with the target and the resulting photons are collected by detectors. The strong intensity of XFEL will make multiple photons hit on one detector pixel and affect the photon energy measurement. Although increasing the distance between the target and detector could reduce the photons pile-up, it causes a waste of photons. So the traditional photon counting spectrum acquisition method is not advantageous in the XFEL case. To meet the requirements on both spectrum acquisition and imaging, we propose a new detection method in this paper.


title: VarArray: Array-Geometry-Agnostic Continuous Speech Separation

abstract: Continuous speech separation using a microphone array was shown to be promising in dealing with the speech overlap problem in natural conversation transcription. This paper proposes VarArray, an array-geometry-agnostic speech separation neural network model. The proposed model is applicable to any number of microphones without retraining while leveraging the nonlinear correlation between the input channels. The proposed method adapts different elements that were proposed before separately, including transform-average-concatenate, conformer speech separation, and inter-channel phase differences, and combines them in an efficient and cohesive way. Large-scale evaluation was performed with two real meeting transcription tasks by using a fully developed transcription system requiring no prior knowledge such as reference segmentations, which allowed us to measure the impact that the continuous speech separation system could have in realistic settings. The proposed model outperformed a previous approach to array-geometry-agnostic modeling for all of the geometry configurations considered, achieving asclite-based speaker-agnostic word error rates of 17.5% and 20.4% for the AMI development and evaluation sets, respectively, in the end-to-end setting using no ground-truth segmentations.


title: Improved Analysis of EDCS via Gallai-Edmonds Decomposition

abstract: In this note, we revisit the edge-degree constrained subgraph (EDCS) introduced by Bernstein and Stein (ICALP'15). An EDCS is a sparse subgraph satisfying simple edge-degree constraints that is guaranteed to include an (almost) $\frac{2}{3}$-approximate matching of the base graph. Since its introduction, the EDCS has been successfully applied to numerous models of computation. Motivated by this success, we revisit EDCS and present an improved bound for its key property in general graphs. Our main result is a new proof of the approximation guarantee of EDCS that builds on the graph's Gallai-Edmonds decomposition, avoiding the probabilistic method of the previous proofs. As a result, we get that to obtain a $(\frac{2}{3} - \epsilon)$-approximation, a sparse EDCS with maximum degree bounded by $O(1/\epsilon)$ is sufficient. This improves the $O(\log(1/\epsilon)/\epsilon^2)$ bound of Assadi and Bernstein (SOSA'19) and the $O(1/\epsilon^3)$ bound of Bernstein and Stein (SODA'16). Our guarantee essentially matches what was previously only known for bipartite graphs, thereby removing the gap in our understanding of EDCS in general vs. bipartite graphs.


title: Seamless Copy Move Manipulation in Digital Images

abstract: The importance and relevance of digital image forensics has attracted researchers to establish different techniques for creating as well as detecting forgeries. The core category in passive image forgery is copy-move image forgery that affects the originality of image by applying a different transformation. In this paper frequency domain image manipulation method is being presented.The method exploits the localized nature of discrete wavelet transform (DWT) to get hold of the region of the host image to be manipulated. Both the patch and host image are subjected to DWT at the same level $l$ to get $3l + 1$ sub-bands and each sub-band of the patch is pasted to the identified region in the corresponding sub-band of the host image. The resultant manipulated host sub-bands are then subjected to inverse DWT to get the final manipulated host image. The proposed method shows good resistance against detection by two frequency domain forgery detection methods from the literature. The purpose of this research work is to create the forgery and highlight the need to produce forgery detection methods that are robust against the malicious copy-move forgery.


title: SEPP: Similarity Estimation of Predicted Probabilities for Defending and Detecting Adversarial Text

abstract: There are two cases describing how a classifier processes input text, namely, misclassification and correct classification. In terms of misclassified texts, a classifier handles the texts with both incorrect predictions and adversarial texts, which are generated to fool the classifier, which is called a victim. Both types are misunderstood by the victim, but they can still be recognized by other classifiers. This induces large gaps in predicted probabilities between the victim and the other classifiers. In contrast, text correctly classified by the victim is often successfully predicted by the others and induces small gaps. In this paper, we propose an ensemble model based on similarity estimation of predicted probabilities (SEPP) to exploit the large gaps in the misclassified predictions in contrast to small gaps in the correct classification. SEPP then corrects the incorrect predictions of the misclassified texts. We demonstrate the resilience of SEPP in defending and detecting adversarial texts through different types of victim classifiers, classification tasks, and adversarial attacks.


title: Nuclear Shell Structure in a Finite-Temperature Relativistic Framework

abstract: The shell evolution of neutron-rich nuclei with temperature is studied in a beyond-mean-field framework rooted in the meson-nucleon Lagrangian. The temperature-dependent Dyson equation with the dynamical kernel taking into account the particle-vibration coupling (PVC) is solved for the fermionic propagators in the basis of the thermal relativistic mean-field Dirac spinors. The calculations are performed for $^{68-78}$Ni in a broad range of temperatures $0 \leq T \leq 4$ MeV. The special focus is put on the fragmentation pattern of the single-particle states, which is further investigated within toy models in strongly truncated model spaces. Such models allow for quantifying the sensitivity of the fragmentation to the phonon frequencies, the PVC strength and to the mean-field level density. The model studies provide insights into the temperature evolution of the PVC mechanism in real nuclear systems under the conditions which may occur in astrophysical environments.

categories: nucl-th astro-ph.SR cond-mat.other nucl-ex


title: SportsSum2.0: Generating High-Quality Sports News from Live Text Commentary

abstract: Sports game summarization aims to generate news articles from live text commentaries. A recent state-of-the-art work, SportsSum, not only constructs a large benchmark dataset, but also proposes a two-step framework. Despite its great contributions, the work has three main drawbacks: 1) the noise existed in SportsSum dataset degrades the summarization performance; 2) the neglect of lexical overlap between news and commentaries results in low-quality pseudo-labeling algorithm; 3) the usage of directly concatenating rewritten sentences to form news limits its practicability. In this paper, we publish a new benchmark dataset SportsSum2.0, together with a modified summarization framework. In particular, to obtain a clean dataset, we employ crowd workers to manually clean the original dataset. Moreover, the degree of lexical overlap is incorporated into the generation of pseudo labels. Further, we introduce a reranker-enhanced summarizer to take into account the fluency and expressiveness of the summarized news. Extensive experiments show that our model outperforms the state-of-the-art baseline.


title: Sensitivity to habitable planets in the \textit{Roman} microlensing survey

abstract: We study the \textit{Roman} sensitivity to exoplanets in the Habitable Zone (HZ). The \textit{Roman}~efficiency for detecting habitable planets is maximized for three classes of planetary microlensing events with close caustic topologies. (a) The events with the lens distances of $D_{\rm l} \gtrsim 7$ kpc, the host lens masses of $M_{\rm h}\gtrsim 0.6M_{\odot}$. By assuming Jupiter-mass planets in the HZs, these events have $q\lesssim 0.001$ and $d\gtrsim 0.17$ ($q$ is their mass ratio and $d$ is the projected planet-host distance on the sky plane normalized to the Einstein radius). The events with primary lenses, $M_{\rm h} \lesssim 0.1 M_{\odot}$, while their lens systems are either (b) close to the observer with $D_{\rm l}\lesssim 1$ kpc or (c) close to the Galactic bulge, $D_{\rm l}\gtrsim 7$ kpc. For Jupiter-mass planets in the HZs of the primary lenses, the events in these two classes have $q\gtrsim 0.01$, $d\lesssim 0.04$. The events in the class (a) make larger caustics. By simulating planetary microlensing events detectable by \textit{Roman},~we conclude that the \textit{Roman}~efficiencies for detecting Earth- and Jupiter-mass planets in the Optimistic HZs (OHZs, which is the region between $[0.5,~2]$ AU around a Sun-like star) are $0.01\%$ and $5\%$, respectively. If we assume that one exoplanet orbits each microlens in microlensing events detectable by \textit{Roman}~( i.e., $\sim 27000$ ),~this telescope has the potential to detects $35$ exoplanets with the projected planet-host distances in the OHZs with only one having a mass $\lesssim 10M_{\oplus}$. According to the simulation, $27$ of these exoplanets are actually in the OHZs.


title: UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training

abstract: Self-supervised learning (SSL) is a long-standing goal for speech processing, since it utilizes large-scale unlabeled data and avoids extensive human labeling. Recent years witness great successes in applying self-supervised learning in speech recognition, while limited exploration was attempted in applying SSL for modeling speaker characteristics. In this paper, we aim to improve the existing SSL framework for speaker representation learning. Two methods are introduced for enhancing the unsupervised speaker information extraction. First, we apply the multi-task learning to the current SSL framework, where we integrate the utterance-wise contrastive loss with the SSL objective function. Second, for better speaker discrimination, we propose an utterance mixing strategy for data augmentation, where additional overlapped utterances are created unsupervisely and incorporate during training. We integrate the proposed methods into the HuBERT framework. Experiment results on SUPERB benchmark show that the proposed system achieves state-of-the-art performance in universal representation learning, especially for speaker identification oriented tasks. An ablation study is performed verifying the efficacy of each proposed method. Finally, we scale up training dataset to 94 thousand hours public audio data and achieve further performance improvement in all SUPERB tasks.


title: Predicting the Efficiency of CO$_2$ Sequestering by Metal Organic Frameworks Through Machine Learning Analysis of Structural and Electronic Properties

abstract: Due the alarming rate of climate change, the implementation of efficient CO$_2$ capture has become crucial. This project aims to create an algorithm that predicts the uptake of CO$_2$ adsorbing Metal-Organic Frameworks (MOFs) by using Machine Learning. These values will in turn gauge the efficiency of these MOFs and provide scientists who are looking to maximize the uptake a way to know whether or not the MOF is worth synthesizing. This algorithm will save resources such as time and equipment as scientists will be able to disregard hypothetical MOFs with low efficiencies. In addition, this paper will also highlight the most important features within the data set. This research will contribute to enable the rapid synthesis of CO$_2$ adsorbing MOFs.


title: Deep Federated Learning for Autonomous Driving

abstract: Autonomous driving is an active research topic in both academia and industry. However, most of the existing solutions focus on improving the accuracy by training learnable models with centralized large-scale data. Therefore, these methods do not take into account the user's privacy. In this paper, we present a new approach to learn autonomous driving policy while respecting privacy concerns. We propose a peer-to-peer Deep Federated Learning (DFL) approach to train deep architectures in a fully decentralized manner and remove the need for central orchestration. We design a new Federated Autonomous Driving network (FADNet) that can improve the model stability, ensure convergence, and handle imbalanced data distribution problems while is being trained with federated learning methods. Intensively experimental results on three datasets show that our approach with FADNet and DFL achieves superior accuracy compared with other recent methods. Furthermore, our approach can maintain privacy by not collecting user data to a central server.


title: Deep learning reconstruction of three-dimensional galaxy distributions with intensity mapping observations

abstract: Line intensity mapping is emerging as a novel method that can measure the collective intensity fluctuations of atomic/molecular line emission from distant galaxies. Several observational programs with various wavelengths are ongoing and planned, but there remains a critical problem of line confusion; emission lines originating from galaxies at different redshifts are confused at the same observed wavelength. We devise a generative adversarial network that extracts designated emission line signals from noisy three-dimensional data. Our novel network architecture allows two input data, in which the same underlying large-scale structure is traced by two emission lines of H$\rm \alpha$ and [OIII], so that the network learns the relative contributions at each wavelength and is trained to decompose the respective signals. After being trained with a large number of realistic mock catalogs, the network is able to reconstruct the three-dimensional distribution of emission-line galaxies at $z = 1.3-2.4$. Bright galaxies are identified with a precision of 84%, and the cross-correlation coefficients between the true and reconstructed intensity maps are as high as 0.8. Our deep-learning method can be readily applied to data from planned space-borne and ground-based experiments.


title: Topological Wannier cycles for the bulk and edges

abstract: Topological materials are often characterized by unique edge states which are in turn used to detect different topological phases in experiments. Recently, with the discovery of various higher-order topological insulators, such spectral topological characteristics are extended from edge states to corner states. However, the chiral symmetry protecting the corner states is often broken in genuine materials, leading to vulnerable corner states even when the higher-order topological numbers remain quantized and invariant. Here, we show that a local artificial gauge flux can serve as a robust probe of the Wannier type higher-order topological insulators which is effective even when the chiral symmetry is broken. The resultant observable signature is the emergence of the cyclic spectral flows traversing one or multiple band gaps. These spectral flows are associated with the local modes bound to the artificial gauge flux. This phenomenon is essentially due to the cyclic transformation of the Wannier orbitals when the local gauge flux acts on them. We extend topological Wannier cycles to systems with C2 and C3 symmetries and show that they can probe both the bulk and the edge Wannier centers, yielding rich topological phenomena.