title: MUAD: Multiple Uncertainties for Autonomous Driving, a benchmark for multiple uncertainty types and tasks

abstract: Predictive uncertainty estimation is essential for safe deployment of Deep Neural Networks in real-world autonomous systems. However, disentangling the different types and sources of uncertainty is non trivial for most datasets, especially since there is no ground truth for uncertainty. In addition, while adverse weather conditions of varying intensities can disrupt neural network predictions, they are usually under-represented in both training and test sets in public datasets.We attempt to mitigate these setbacks and introduce the MUAD dataset (Multiple Uncertainties for Autonomous Driving), consisting of 10,413 realistic synthetic images with diverse adverse weather conditions (night, fog, rain, snow), out-of-distribution objects, and annotations for semantic segmentation, depth estimation, object, and instance detection. MUAD allows to better assess the impact of different sources of uncertainty on model performance. We conduct a thorough experimental study of this impact on several baseline Deep Neural Networks across multiple tasks, and release our dataset to allow researchers to benchmark their algorithm methodically in adverse conditions. More visualizations and the download link for MUAD are available at https://muad-dataset.github.io/.


title: EnclaveTree: Privacy-preserving Data Stream Training and Inference Using TEE

abstract: The classification service over a stream of data is becoming an important offering for cloud providers, but users may encounter obstacles in providing sensitive data due to privacy concerns. While Trusted Execution Environments (TEEs) are promising solutions for protecting private data, they remain vulnerable to side-channel attacks induced by data-dependent access patterns. We propose a Privacy-preserving Data Stream Training and Inference scheme, called EnclaveTree, that provides confidentiality for user's data and the target models against a compromised cloud service provider. We design a matrix-based training and inference procedure to train the Hoeffding Tree (HT) model and perform inference with the trained model inside the trusted area of TEEs, which provably prevent the exploitation of access-pattern-based attacks. The performance evaluation shows that EnclaveTree is practical for processing the data streams with small or medium number of features. When there are less than 63 binary features, EnclaveTree is up to ${\thicksim}10{\times}$ and ${\thicksim}9{\times}$ faster than na\"ive oblivious solution on training and inference, respectively.


title: Enhancing Adversarial Robustness for Deep Metric Learning

abstract: Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the min-max adversarial training, but instead learn from a weak adversary inefficiently. Conversely, we propose Hardness Manipulation to efficiently perturb the training triplet till a specified level of hardness for adversarial training, according to a harder benign triplet or a pseudo-hardness function. It is flexible since regular training and min-max adversarial training are its boundary cases. Besides, Gradual Adversary, a family of pseudo-hardness functions is proposed to gradually increase the specified hardness level during training for a better balance between performance and robustness. Additionally, an Intra-Class Structure loss term among benign and adversarial examples further improves model robustness and efficiency. Comprehensive experimental results suggest that the proposed method, although simple in its form, overwhelmingly outperforms the state-of-the-art defenses in terms of robustness, training efficiency, as well as performance on benign examples.


title: Near-Optimal Correlation Clustering with Privacy

abstract: Correlation clustering is a central problem in unsupervised learning, with applications spanning community detection, duplicate detection, automated labelling and many more. In the correlation clustering problem one receives as input a set of nodes and for each node a list of co-clustering preferences, and the goal is to output a clustering that minimizes the disagreement with the specified nodes' preferences. In this paper, we introduce a simple and computationally efficient algorithm for the correlation clustering problem with provable privacy guarantees. Our approximation guarantees are stronger than those shown in prior work and are optimal up to logarithmic factors.


title: 3D Common Corruptions and Data Augmentation

abstract: We introduce a set of image transformations that can be used as corruptions to evaluate the robustness of models as well as data augmentation mechanisms for training neural networks. The primary distinction of the proposed transformations is that, unlike existing approaches such as Common Corruptions, the geometry of the scene is incorporated in the transformations -- thus leading to corruptions that are more likely to occur in the real world. We also introduce a set of semantic corruptions (e.g. natural object occlusions). We show these transformations are `efficient' (can be computed on-the-fly), `extendable' (can be applied on most image datasets), expose vulnerability of existing models, and can effectively make models more robust when employed as `3D data augmentation' mechanisms. The evaluations on several tasks and datasets suggest incorporating 3D information into benchmarking and training opens up a promising direction for robustness research.


title: Deformable Radar Polygon: A Lightweight and Predictable Occupancy Representation for Short-range Collision Avoidance

abstract: Inferring the drivable area in a scene is a key capability for ensuring the vehicle avoids obstacles and enabling safe autonomous driving. However, a traditional occupancy grid map suffers from high memory consumption when forming a fine-resolution grid for a large map. In this paper, we propose a lightweight, accurate, and predictable occupancy representation for automotive radars working for short-range applications that take interest in instantaneous free space surrounding the sensor. This new occupancy format is a polygon composed of a bunch of vertices selected from noisy radar measurements, which covers free space inside and gives a Doppler moving velocity for each vertex. It not only takes a very small memory and computing resources for storage and updating at every timeslot but also has the predictable shape-change property based on vertex's Doppler velocity. We name this kind of occupancy representation 'deformable radar polygon'. Two formation algorithms for radar polygon are introduced for both single timeslot and continuous inverse sensor model update. To fit this new polygon representation, a matrix-form collision detection method has been modeled as well. The radar polygon algorithms and collision detection model have been validated via extensive experiments with real collected data and simulations, showing that the deformable radar polygon is very competitive in terms of its completeness, smoothness, accuracy, lightweight as well as the shape-predictable property. Our codes will be made available at https://github.com/Xiangyu-Gao/deformable_radar_polygon_occupancy_representation.


title: Continuous-Time Meta-Learning with Forward Mode Differentiation

abstract: Drawing inspiration from gradient-based meta-learning methods with infinitely small gradient steps, we introduce Continuous-Time Meta-Learning (COMLN), a meta-learning algorithm where adaptation follows the dynamics of a gradient vector field. Specifically, representations of the inputs are meta-learned such that a task-specific linear classifier is obtained as a solution of an ordinary differential equation (ODE). Treating the learning process as an ODE offers the notable advantage that the length of the trajectory is now continuous, as opposed to a fixed and discrete number of gradient steps. As a consequence, we can optimize the amount of adaptation necessary to solve a new task using stochastic gradient descent, in addition to learning the initial conditions as is standard practice in gradient-based meta-learning. Importantly, in order to compute the exact meta-gradients required for the outer-loop updates, we devise an efficient algorithm based on forward mode differentiation, whose memory requirements do not scale with the length of the learning trajectory, thus allowing longer adaptation in constant memory. We provide analytical guarantees for the stability of COMLN, we show empirically its efficiency in terms of runtime and memory usage, and we illustrate its effectiveness on a range of few-shot image classification problems.


title: Hierarchical Supervisory Control under Partial Observation: Normality

abstract: Conditions preserving observability of specifications between the plant and its abstraction are essential for hierarchical supervisory control of discrete-event systems under partial observation. Observation consistency and local observation consistency were identified as such conditions. To preserve normality, only observation consistency is required. Although observation consistency preserves normality between the levels for normal specifications, for specifications that are not normal, observation consistency is insufficient to guarantee that the supremal normal sublanguage computed on the low level and on the high level coincide. We define modified observation consistency, under which the supremal normal sublanguages of different levels coincide. We show that the verification of (modified) observation consistency is PSPACE-hard for finite automata and undecidable for slightly more expressive models than finite automata. Decidability of (modified) observation consistency is an open problem. Hence we further discuss two stronger conditions that are easy to verify. Finally, we illustrate the conditions on an example of a railroad controller and on a case study of a part of an MRI scanner.


title: LILE: Look In-Depth before Looking Elsewhere -- A Dual Attention Network using Transformers for Cross-Modal Information Retrieval in Histopathology Archives

abstract: The volume of available data has grown dramatically in recent years in many applications. Furthermore, the age of networks that used multiple modalities separately has practically ended. Therefore, enabling bidirectional cross-modality data retrieval capable of processing has become a requirement for many domains and disciplines of research. This is especially true in the medical field, as data comes in a multitude of types, including various types of images and reports as well as molecular data. Most contemporary works apply cross attention to highlight the essential elements of an image or text in relation to the other modalities and try to match them together. However, regardless of their importance in their own modality, these approaches usually consider features of each modality equally. In this study, self-attention as an additional loss term will be proposed to enrich the internal representation provided into the cross attention module. This work suggests a novel architecture with a new loss term to help represent images and texts in the joint latent space. Experiment results on two benchmark datasets, i.e. MS-COCO and ARCH, show the effectiveness of the proposed method.


title: RoLoMa: Robust Loco-Manipulation for Quadruped Robots with Arms

abstract: Deployment of robotic systems in the real world requires a certain level of robustness in order to deal with uncertainty factors, such as mismatches in the dynamics model, noise in sensor readings, and communication delays. Some approaches tackle these issues reactively at the control stage. However, regardless of the controller, online motion execution can only be as robust as the system capabilities allow at any given state. This is why it is important to have good motion plans to begin with, where robustness is considered proactively. To this end, we propose a metric (derived from first principles) for representing robustness against external disturbances. We then use this metric within our trajectory optimization framework for solving complex loco-manipulation tasks. Through our experiments, we show that trajectories generated using our approach can resist a greater range of forces originating from any possible direction. By using our method, we can compute trajectories that solve tasks as effectively as before, with the added benefit of being able to counteract stronger disturbances in worst-case scenarios.


title: Learning Stochastic Parametric Differentiable Predictive Control Policies

abstract: The problem of synthesizing stochastic explicit model predictive control policies is known to be quickly intractable even for systems of modest complexity when using classical control-theoretic methods. To address this challenge, we present a scalable alternative called stochastic parametric differentiable predictive control (SP-DPC) for unsupervised learning of neural control policies governing stochastic linear systems subject to nonlinear chance constraints. SP-DPC is formulated as a deterministic approximation to the stochastic parametric constrained optimal control problem. This formulation allows us to directly compute the policy gradients via automatic differentiation of the problem's value function, evaluated over sampled parameters and uncertainties. In particular, the computed expectation of the SP-DPC problem's value function is backpropagated through the closed-loop system rollouts parametrized by a known nominal system dynamics model and neural control policy which allows for direct model-based policy optimization. We provide theoretical probabilistic guarantees for policies learned via the SP-DPC method on closed-loop stability and chance constraints satisfaction. Furthermore, we demonstrate the computational efficiency and scalability of the proposed policy optimization algorithm in three numerical examples, including systems with a large number of states or subject to nonlinear constraints.


title: Counting Points on Igusa Varieties of Hodge Type

abstract: Igusa varieties are algebraic varieties that arise in the study of special fibers of Shimura varieties, and have demonstrated many applications in the Langlands program via a Langlands-Kottwitz style point-counting formula due to Shin in the case of PEL type. In this paper we formulate and prove an analogue of the Langlands-Rapoport conjecture for Igusa varieties of Hodge type, building off the work of Kisin in the case of Shimura varieties. We then use this description of the points to derive a point-counting formula for Igusa varieties of Hodge type, generalizing the fomula in PEL type of Shin, by drawing on the techniques of Kisin-Shin-Zhu.


title: Object Pose Estimation using Mid-level Visual Representations

abstract: This work proposes a novel pose estimation model for object categories that can be effectively transferred to previously unseen environments. The deep convolutional network models (CNN) for pose estimation are typically trained and evaluated on datasets specifically curated for object detection, pose estimation, or 3D reconstruction, which requires large amounts of training data. In this work, we propose a model for pose estimation that can be trained with small amount of data and is built on the top of generic mid-level representations \cite{taskonomy2018} (e.g. surface normal estimation and re-shading). These representations are trained on a large dataset without requiring pose and object annotations. Later on, the predictions are refined with a small CNN neural network that exploits object masks and silhouette retrieval. The presented approach achieves superior performance on the Pix3D dataset \cite{pix3d} and shows nearly 35\% improvement over the existing models when only 25\% of the training data is available. We show that the approach is favorable when it comes to generalization and transfer to novel environments. Towards this end, we introduce a new pose estimation benchmark for commonly encountered furniture categories on challenging Active Vision Dataset \cite{Ammirato2017ADF} and evaluated the models trained on the Pix3D dataset.


title: IGR J18249-3243: a new GeV-emitting FR II and the emerging population of high energy radio galaxies

abstract: The advent of new all-sky radio surveys such as the VLA Sky Survey (VLASS) and the Rapid ASKAP Continuum Survey (RACS), performed with the latest generation radio telescopes, is opening new possibilities on the classification and study of extragalactic $\gamma$-ray sources, specially the underrepresented ones like radio galaxies. In particular, the enhanced sensitivity (sub-mJy level) and resolution (a few arcsec) provides a better morphological and spectral classification. In this work, we present the reclassification of a Fermi-LAT source as a new FRII radio galaxy from the INTEGRAL sample found to emit at GeV energies. Through a broad-band spectral fitting from radio to $\gamma$-ray, we find that the commonly invoked jet contribution is not sufficient to account for the observed $\gamma$-ray flux. Our modeling suggests that the observed emission could mainly originate in the lobes (rather than in the radio core) by inverse Compton scattering of radio-emitting electrons off the ambient photon fields. In addition, we cross-correlated the latest generation radio surveys with a list of Fermi-LAT objects from the literature considered to be candidate misaligned AGN, finding four new radio galaxies with a double-lobed morphology. Additional four objects could be classified as such thanks to previous studies in the literature, for a total of nine new radio galaxies with GeV emission presented in this work. We foresee that further objects of this class might be found in the near future with the advent of the Square Kilometer Array (SKA), populating the GeV sky.


title: Label Leakage and Protection from Forward Embedding in Vertical Federated Learning

abstract: Vertical federated learning (vFL) has gained much attention and been deployed to solve machine learning problems with data privacy concerns in recent years. However, some recent work demonstrated that vFL is vulnerable to privacy leakage even though only the forward intermediate embedding (rather than raw features) and backpropagated gradients (rather than raw labels) are communicated between the involved participants. As the raw labels often contain highly sensitive information, some recent work has been proposed to prevent the label leakage from the backpropagated gradients effectively in vFL. However, these work only identified and defended the threat of label leakage from the backpropagated gradients. None of these work has paid attention to the problem of label leakage from the intermediate embedding. In this paper, we propose a practical label inference method which can steal private labels effectively from the shared intermediate embedding even though some existing protection methods such as label differential privacy and gradients perturbation are applied. The effectiveness of the label attack is inseparable from the correlation between the intermediate embedding and corresponding private labels. To mitigate the issue of label leakage from the forward embedding, we add an additional optimization goal at the label party to limit the label stealing ability of the adversary by minimizing the distance correlation between the intermediate embedding and corresponding private labels. We conducted massive experiments to demonstrate the effectiveness of our proposed protection methods.


title: Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation

abstract: Panoramic images with their 360-degree directional view encompass exhaustive information about the surrounding space, providing a rich foundation for scene understanding. To unfold this potential in the form of robust panoramic segmentation models, large quantities of expensive, pixel-wise annotations are crucial for success. Such annotations are available, but predominantly for narrow-angle, pinhole-camera images which, off the shelf, serve as sub-optimal resources for training panoramic models. Distortions and the distinct image-feature distribution in 360-degree panoramas impede the transfer from the annotation-rich pinhole domain and therefore come with a big dent in performance. To get around this domain difference and bring together semantic annotations from pinhole- and 360-degree surround-visuals, we propose to learn object deformations and panoramic image distortions in the Deformable Patch Embedding (DPE) and Deformable MLP (DMLP) components which blend into our Transformer for PAnoramic Semantic Segmentation (Trans4PASS) model. Finally, we tie together shared semantics in pinhole- and panoramic feature embeddings by generating multi-scale prototype features and aligning them in our Mutual Prototypical Adaptation (MPA) for unsupervised domain adaptation. On the indoor Stanford2D3D dataset, our Trans4PASS with MPA maintains comparable performance to fully-supervised state-of-the-arts, cutting the need for over 1,400 labeled panoramas. On the outdoor DensePASS dataset, we break state-of-the-art by 14.39% mIoU and set the new bar at 56.38%. Code will be made publicly available at https://github.com/jamycheung/Trans4PASS.


title: Atomic-Scale Spin-Wave Polarizer Based on a Sharp Antiferromagnetic Domain Wall

abstract: We theoretically study the scattering of spin waves from a sharp domain wall in an antiferromagnetic spin chain. While the continuum model for an antiferromagnetic material yields the well-known result that spin waves can pass through a wide domain wall with no reflection, here we show that, based on the discrete spin Hamiltonian, spin waves are generally reflected by a domain wall with a reflection coefficient that increases as the domain-wall width decreases. Remarkably, we find that, in the interesting case of an atomically sharp domain wall, the reflection of spin waves exhibits strong dependence on the state of circular polarization of the spin waves, leading to mainly reflection for one polarization while permitting partial transmission for the other, thus realizing an atomic-scale spin-wave polarizer. The polarization of the transmitted spin wave depends on the orientation of the spin in the sharp domain wall, which can be controlled by an external field or spin torque. Our utilization of a sharp antiferromagnetic domain wall as an atomic-scale spin-wave polarizer leads us to envision that ultra-small magnetic solitons such as domain walls and skyrmions may enable realizations of atomic-scale spin-wave scatterers with useful functionalities.


title: Global Continuation of a Vlasov Model of Rotating Galaxies

abstract: A typical galaxy consists of a huge number of stars attracted to each other by gravity. For instance, the Milky Way has about $10^{11}$ stars. Thus it is typically modeled by the Vlasov-Poisson system. We prove an existence theorem for axisymmetric steady states of galaxies that may rotate rapidly. Such states are given in terms of a fairly general function $\phi$ of the particle energy and angular momentum. The set $\mathcal K$ of such states form a connected set in an appropriate function space. Along the set $\mathcal K$, we prove under some conditions that either (a) the supports of the galaxies become unbounded or (b) both the rotation speeds and the densities somewhere within the galaxy become unbounded.


title: A relationship and not a thing: A relational approach to algorithmic accountability and assessment documentation

abstract: Central to a number of scholarly, regulatory, and public conversations about algorithmic accountability is the question of who should have access to documentation that reveals the inner workings, intended function, and anticipated consequences of algorithmic systems, potentially establishing new routes for impacted publics to contest the operations of these systems. Currently, developers largely have a monopoly on information about how their systems actually work and are incentivized to maintain their own ignorance about aspects of how their systems affect the world. Increasingly, legislators, regulators and advocates have turned to assessment documentation in order to address the gap between the public's experience of algorithmic harms and the obligations of developers to document and justify their design decisions. However, issues of standing and expertise currently prevent publics from cohering around shared interests in preventing and redressing algorithmic harms; as we demonstrate with multiple cases, courts often find computational harms non-cognizable and rarely require developers to address material claims of harm. Constructed with a triadic accountability relationship, algorithmic impact assessment regimes could alter this situation by establishing procedural rights around public access to reporting and documentation. Developing a relational approach to accountability, we argue that robust accountability regimes must establish opportunities for publics to cohere around shared experiences and interests, and to contest the outcomes of algorithmic systems that affect their lives. Furthermore, algorithmic accountability policies currently under consideration in many jurisdictions must provide the public with adequate standing and opportunities to access and contest the documentation provided by the actors and the judgments passed by the forum.


title: A global bifurcation organizing rhythmic activity in a coupled network

abstract: We study a system of coupled phase oscillators near a saddle-node on an invariant circle bifurcation and driven by random intrinsic frequencies. Under the variation of control parameters, the system undergoes a phase transition changing the qualitative properties of collective dynamics. Using the Ott-Antonsen reduction and geometric techniques for ordinary differential equations, we identify a heteroclinic bifurcation in a family of vector fields on a cylinder, which explains the change in collective dynamics. Specifically, we show that the heteroclinic bifurcation separates two topologically distinct families of limit cycles: contractible limit cycles before the bifurcation from noncontractibile ones after the bifurcation. Both families are stable for the model at hand.


title: Analytical expressions for thermophysical properties of solid and liquid beryllium relevant for fusion applications

abstract: The status of the literature is reviewed for thermophysical properties of pure polycrystalline solid and liquid beryllium which constitute input for the modelling of intense plasma-surface interaction phenomena that are important for fusion applications (thermal analysis, vapor shielding, melt motion, arcing, dust generation, dust transport). Reliable experimental data are analyzed for the latent heats, specific isobaric heat capacity, electrical resistivity, thermal conductivity, mass density, vapor pressure, work function, total hemispherical emissivity and absolute thermoelectric power from the room temperature up to the normal boiling point of beryllium as well as for the surface tension and the dynamic viscosity across the liquid state. Analytical expressions are recommended for the temperature dependence of these thermophysical properties, which involve high temperature extrapolations given the absence of extended liquid beryllium measurements.


title: Spectral function of chiral one-dimensional Fermi liquid in the regime of strong interactions

abstract: We study momentum-resolved tunneling into a system of spinless chiral one-dimensional fermions, such as electrons at the edge of an integer quantum Hall system. Interactions between particles give rise to broadening of the spectral function of the system. We develop an approach that enables one to obtain the shape of the peak in the spectral function in the regime of strong interaction. We apply our technique to the special cases of short-range and Coulomb interactions.


title: Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processes

abstract: Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to facilitate the selection of promising input values. Gaussian processes (GPs) are commonly used as surrogate models but are known to scale poorly with the number of observations. We adapt the Vecchia approximation, a popular GP approximation from spatial statistics, to enable scalable high-dimensional Bayesian optimization. We develop several improvements and extensions, including training warped GPs using mini-batch gradient descent, approximate neighbor search, and selecting multiple input values in parallel. We focus on the use of our warped Vecchia GP in trust-region Bayesian optimization via Thompson sampling. On several test functions and on two reinforcement-learning problems, our methods compared favorably to the state of the art.


title: Propagating spatially-varying multiplicative shear bias to cosmological parameter estimation for stage-IV weak-lensing surveys

abstract: We consider the bias introduced by a spatially-varying multiplicative shear bias (m-bias) on tomographic cosmic shear angular power spectra. To compute the bias in the power spectra, we estimate the mode-coupling matrix associated with an m-bias map using a computationally-efficient pseudo-Cl method. This allows us to consider the effect of the m-bias to high l. We then conduct a Fisher matrix analysis to forecast resulting biases in cosmological parameters. For a Euclid-like survey with a spatially-varying m-bias, with zero mean and rms of 0.01, we find that parameter biases reach a maximum of ~10% of the expected statistical error, if multipoles up to l_max = 5000 are included. We conclude that the effect of the spatially-varying m-bias may be a sub-dominant but potentially non-negligible contribution to the error budget in forthcoming weak lensing surveys. We also investigate the dependence of parameter biases on the amplitude and angular scale of spatial variations of the m-bias field, and conclude that requirements should be placed on the rms of spatial variations of the m-bias, in addition to any requirement on the mean value. We find that, for a Euclid-like survey, biases generally exceed ~30% of the statistical error for m-bias rms 0.02 - 0.03 and can exceed the statistical error for rms ~0.04 - 0.05. This allows requirements to be set on the permissible amplitude of spatial variations of the m-bias that will arise due to systematics in forthcoming weak lensing measurements.


title: The Final Season Reimagined: 30 Tidal Disruption Events from the ZTF-I Survey

abstract: Tidal disruption events (TDEs) offer a unique way to study dormant black holes. While the number of observed TDEs has grown thanks to the emergence of wide-field surveys in the past few decades, questions regarding the nature of the observed optical, UV, and X-ray emission remain. We present a uniformly selected sample of 30 spectroscopically classified TDEs from the Zwicky Transient Facility Phase I survey operations with follow-up \textit{Swift} UV and X-ray observations. Through our investigation into correlations between light curve properties, we recover a shallow positive correlation between the peak bolometric luminosity and decay timescales. We introduce a new spectroscopic class of TDE, TDE-featureless, which are characterized by featureless optical spectra. The new TDE-featureless class shows larger peak bolometric luminosities, peak blackbody temperatures, and peak blackbody radii. We examine the differences between the X-ray bright and X-ray faint populations of TDEs in this sample, finding that X-ray bright TDEs show higher peak blackbody luminosities than the X-ray faint sub-sample. This sample of optically selected TDEs is the largest sample of TDEs from a single survey yet, and the systematic discovery, classification, and follow-up of this sample allows for robust characterization of TDE properties, an important stepping stone looking forward toward the Rubin era.


title: Topology optimization of dispersive plasmonic nanostructures in the time-domain

abstract: Topology optimization techniques have been applied in integrated optics and nanophotonics for the inverse design of devices with shapes that cannot be conceived by human intuition. At optical frequencies, these techniques have only been utilized to optimize nondispersive materials using frequency-domain methods. However, a time-domain formulation is more efficient to optimize materials with dispersion. We introduce such a formulation for the Drude model, which is widely used to simulate the dispersive properties of metals, conductive oxides, and conductive polymers. Our topology optimization algorithm is based on the finite-difference time-domain (FDTD) method, and we introduce a time-domain sensitivity analysis that enables the evaluation of the gradient information by using one additional FDTD simulation. The existence of dielectric and metallic structures in the design space produces plasmonic field enhancement that causes convergence issues. We employ an artificial damping approach during the optimization iterations that, by reducing the plasmonic effects, solves the convergence problem. We present several design examples of 2D and 3D plasmonic nanoantennas with optimized field localization and enhancement in frequency bands of choice. Our method has the potential to speed up the design of wideband optical nanostructures made of dispersive materials for applications in nanoplasmonics, integrated optics, ultrafast photonics, and nonlinear optics.


title: Confirmation of Water Absorption in the Thermal Emission Spectrum of the Hot Jupiter WASP-77Ab with HST/WFC3

abstract: Secondary eclipse observations of hot Jupiters can reveal both their compositions and thermal structures. Previous observations have shown a diversity of hot Jupiter eclipse spectra, including absorption features, emission features, and featureless blackbody-like spectra. We present a secondary eclipse spectrum of the hot Jupiter WASP-77Ab observed between $1-5$ $\mu$m with the Hubble Space Telescope (HST) and the Spitzer Space Telescope. The HST observations show signs of water absorption indicative of a non-inverted thermal structure. We fit the data with both a one-dimensional free retrieval and a grid of one-dimensional self-consistent forward models to confirm this non-inverted structure. The free retrieval places a $3\sigma$ lower limit on the atmospheric water abundance of $\log(n_\mathrm{H_2O})>-4.78$ and can not constrain the CO abundance. The grid fit produces a slightly super-stellar metallicity and constrains the carbon-to-oxygen ratio to less than or equal to the solar value. We also compare our data to recent high-resolution observations of WASP-77Ab taken with the Gemini-South/IGRINS spectrograph and find that our observations are consistent with the best-fit model to the high-resolution data. However, the metallicity derived from the IGRINS data is significantly lower than that derived from our self-consistent model fit. We find that this difference may be due to disequilibrium chemistry, and the varying results between the models applied here demonstrate the difficulty of constraining disequilibrium chemistry with low-resolution, low wavelength coverage data alone. Future work to combine observations from IGRINS, HST, and JWST will improve our estimate of the atmospheric composition of WASP-77Ab.


title: A Survey of Analysis Methods for Security and Safety verification in IoT Systems

abstract: Internet of Things (IoT) has been rapidly growing in the past few years in all life disciplines. IoT provides automation and smart control to its users in different domains such as home automation, healthcare systems, automotive, and many more. Given the tremendous number of connected IoT devices, this growth leads to enormous automatic interactions among sizeable IoT apps in their environment, making IoT apps more intelligent and more enjoyable to their users. But some unforeseen interactions of IoT apps and any potential malicious behaviour can seriously cause insecure and unsafe consequences to its users, primarily non-experts, who lack the required knowledge regarding the potential impact of their IoT automation processes. In this paper, we study the problem of security and safety verification of IoT systems. We survey techniques that utilize program analysis to verify IoT applications' security and safety properties. The study proposes a set of categorization and classification attributes to enhance our understanding of the research landscape in this domain. Moreover, we discuss the main challenges considered in the surveyed work and potential solutions that could be adopted to ensure the security and safety of IoT systems.


title: Deep Q-network using reservoir computing with multi-layered readout

abstract: Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has some issues that the learning procedures tend to be more computationally expensive, and training with backpropagation through time (BPTT) is unstable because of vanishing/exploding gradients problem. An approach with replay memory introducing reservoir computing has been proposed, which trains an agent without BPTT and avoids these issues. The basic idea of this approach is that observations from the environment are input to the reservoir network, and both the observation and the reservoir output are stored in the memory. This paper shows that the performance of this method improves by using a multi-layered neural network for the readout layer, which regularly consists of a single linear layer. The experimental results show that using multi-layered readout improves the learning performance of four classical control tasks that require time-series processing.


title: Successful Recovery of an Observed Meteorite Fall Using Drones and Machine Learning

abstract: We report the first-time recovery of a fresh meteorite fall using a drone and a machine learning algorithm. A fireball on the 1st April 2021 was observed over Western Australia by the Desert Fireball Network, for which a fall area was calculated for the predicted surviving mass. A search team arrived on site and surveyed 5.1 km2 area over a 4-day period. A convolutional neural network, trained on previously-recovered meteorites with fusion crusts, processed the images on our field computer after each flight. meteorite candidates identified by the algorithm were sorted by team members using two user interfaces to eliminate false positives. Surviving candidates were revisited with a smaller drone, and imaged in higher resolution, before being eliminated or finally being visited in-person. The 70 g meteorite was recovered within 50 m of the calculated fall line using, demonstrating the effectiveness of this methodology which will facilitate the efficient collection of many more observed meteorite falls.

categories: astro-ph.EP cs.LG physics.geo-ph physics.space-ph


title: Thomas-Yau conjecture and holomorphic curves

abstract: The main theme of this paper is the Thomas-Yau conjecture, primarily in the setting of exact, (quantitatively) almost calibrated, unobstructed Lagrangian branes inside Calabi-Yau Stein manifolds. In our interpretation, the conjecture is that Thomas-Yau semistability is equivalent to the existence of special Lagrangian representatives. We clarify how holomorphic curves enter this conjectural picture, through the construction of bordism currents between Lagrangians, and in the definition of the Solomon functional. Under some extra hypothesis, we shall prove Floer theoretic obstructions to the existence of special Lagrangians, using the technique of integration over moduli spaces. In the converse direction, we set up a variational framework with the goal of finding special Lagrangians under the Thomas-Yau semistability asumption, and we shall make sufficient progress to pinpoint the outstanding technical difficulties, both in Floer theory and in geometric measure theory.


title: Quasi time crystal

abstract: We discuss the possibility of making a quasi time crystal. A simple two-state model is studied to clarify our definition. In a superposition of the ground state and the excited state and the probability of observation varies periodically in time during the lifetime of the excited state. The quasi time crystal is also discussed around the first order quantum phase transition, which is characterized by the degeneracy and crossing of the two lowest-energy states in the infinite-volume limit. Our results have broad validity. As an example, the one-dimensional transverse field Ising model with surface fields is shown to have similar behavior. The oscillating magnetization profile is solved exactly.


title: The $Higgs\to b\bar{b}, c\bar{c}, gg$ measurement at CEPC

abstract: Accurately measuring the properties of the Higgs boson is one of the core physics objectives of the Circular Electron Positron Collider (CEPC). As a Higgs factory, the CEPC is expected to operate at a centre-of-mass energy of $240\,GeV$, deliver an integrated luminosity of $5.6\,ab^{-1}$, and produce one million Higgs bosons according to the CEPC Conceptual Design Report (CDR). Combining measurements of the $\ell^+\ell^-H$, $\nu\bar{\nu} H$, and $q\bar{q}H$ channels, we conclude that the signal strength of $H\to b\bar{b}/c\bar{c}/gg$ can be measured with a relative accuracy (statistic uncertainty only) of 0.27\%/4.03\%/1.56\%. Extrapolating to the recently released TDR operating parameters corresponding to the integrated luminosity of $20\,ab^{-1}$, the relative accuracy of $H\to b\bar{b}/c\bar{c}/gg$ signal strength is 0.14\%/2.13\%/0.82\%. We analyze the dependence of the expected accuracies on the critical detector performances: Color Singlet Identification (CSI) for the $q\bar{q}H$ channel and flavor tagging for both $\nu\bar{\nu} H$ and $q\bar{q}H$ channels. We observe that compared to the baseline CEPC detector performance, ideal flavor tagging increases the $H\to b\bar{b}/c\bar{c}/gg$ signal strength accuracy by 2\%/63\%/13\% in the $\nu\bar{\nu} H$ channel and 35\%/122\%/181\% in the $q\bar{q}H$ channel. In addition, better performance of CSI can significantly improve the anticipated accuracy of signal strength. The relevant systematics are also discussed in this paper.


title: Doubly-polarized WZ hadronic cross sections at NLO QCD+EW accuracy

abstract: We present new results for next-to-leading order (NLO) electroweak (EW) corrections to double polarization signals in the $WZ$ production channel at the LHC using the $e^+\nu_e \mu^+ \mu^-$ final state. It is found that the EW corrections are most sizable in the transverse momentum distributions of the doubly longitudinal polarization, being around -10% compared to the NLO QCD prediction at $p_{T,e}\approx 200$ GeV, which is in the accessible energy range of the current LHC data.


title: Structure Learning of Latent Factors via Clique Search on Correlation Thresholded Graphs

abstract: Despite the widespread application of latent factor analysis, existing methods suffer from the following weaknesses: requiring the number of factors to be known, lack of theoretical guarantees for learning the model structure, and nonidentifiability of the parameters due to rotation invariance properties of the likelihood. We address these concerns by proposing a fast correlation thresholding (CT) algorithm that simultaneously learns the number of latent factors and a rotationally identifiable model structure. Our novel approach translates this structure learning problem into the search for so-called independent maximal cliques in a thresholded correlation graph that can be easily constructed from the observed data. Our clique analysis technique scales well up to thousands of variables, while competing methods are not applicable in a reasonable amount of running time. We establish a finite-sample error bound and high-dimensional consistency for the structure learning of our method. Through a series of simulation studies and a real data example, we show that the CT algorithm is an accurate method for learning the structure of factor analysis models and is robust to violations of its assumptions.


title: Moments dynamics and stationary states for classical diffusion-type GKSL equations

abstract: The explicit dynamics of the moments for the GKSL equation and the approach in finding stationary Gaussian states are obtained. In our case the GKSL equation corresponds to Wiener stochastic processes. Such equations contain a double commutator which can be understood as a quantum analog of the second spatial derivative.


title: Powers of posinormal Hilbert-space operators

abstract: A bounded linear operator $A$ on a Hilbert space $\mathcal{H}$ is posinormal if there exists a positive operator $P$ such that $AA^{*} = A^{*}PA$. We show that if $A$ is posinormal with closed range, then $A^n$ is posinormal and has closed range for all integers $n\ge 1$. Because the collection of posinormal operators includes all hyponormal operators, we obtain as a corollary that powers of closed-range hyponormal operators continue to have closed range. We also present a simple example of a closed-range operator $T: \mathcal{H}\to \mathcal{H}$ such that $T^2$ does not have closed range.


title: Spatio-Temporal Gating-Adjacency GCN for Human Motion Prediction

abstract: Predicting future motion based on historical motion sequence is a fundamental problem in computer vision, and it has wide applications in autonomous driving and robotics. Some recent works have shown that Graph Convolutional Networks(GCN) are instrumental in modeling the relationship between different joints. However, considering the variants and diverse action types in human motion data, the cross-dependency of the spatio-temporal relationships will be difficult to depict due to the decoupled modeling strategy, which may also exacerbate the problem of insufficient generalization. Therefore, we propose the Spatio-Temporal Gating-Adjacency GCN(GAGCN) to learn the complex spatio-temporal dependencies over diverse action types. Specifically, we adopt gating networks to enhance the generalization of GCN via the trainable adaptive adjacency matrix obtained by blending the candidate spatio-temporal adjacency matrices. Moreover, GAGCN addresses the cross-dependency of space and time by balancing the weights of spatio-temporal modeling and fusing the decoupled spatio-temporal features. Extensive experiments on Human 3.6M, AMASS, and 3DPW demonstrate that GAGCN achieves state-of-the-art performance in both short-term and long-term predictions.


title: CycleMix: A Holistic Strategy for Medical Image Segmentation from Scribble Supervision

abstract: Curating a large set of fully annotated training data can be costly, especially for the tasks of medical image segmentation. Scribble, a weaker form of annotation, is more obtainable in practice, but training segmentation models from limited supervision of scribbles is still challenging. To address the difficulties, we propose a new framework for scribble learning-based medical image segmentation, which is composed of mix augmentation and cycle consistency and thus is referred to as CycleMix. For augmentation of supervision, CycleMix adopts the mixup strategy with a dedicated design of random occlusion, to perform increments and decrements of scribbles. For regularization of supervision, CycleMix intensifies the training objective with consistency losses to penalize inconsistent segmentation, which results in significant improvement of segmentation performance. Results on two open datasets, i.e., ACDC and MSCMRseg, showed that the proposed method achieved exhilarating performance, demonstrating comparable or even better accuracy than the fully-supervised methods. The code and expert-made scribble annotations for MSCMRseg are publicly available at https://github.com/BWGZK/CycleMix.


title: Identification of active slip systems in polycrystals by Slip Trace -- Modified Lattice Rotation Analysis (ST-MLRA)

abstract: A simple and versatile strategy, denominated Slip Trace - Modified Lattice Rotation Analysis (ST-MLRA), is presented to enable the identification of the active slip systems in polycrystalline alloys from surface information. The slip plane trace orientation is used to define the potential active slip planes while the actual slip direction within the active slip plane is obtained from the grain rotation, as indicated by the stretching of the trace of the grain orientation in the pole figure as a result of deformation. Examples of application of the strategy in a HCP Mg alloy are presented for illustration. They show that the strategy is simple to implement and allows to identify the active slip system(s) in each grain.


title: A Matching Mechanism for Provision of Housing to the Marginalized

abstract: During this pandemic, there have been unprecedented community and local government efforts to slow down the spread of the coronavirus, and also to protect our local economies. One such effort is California's project Roomkey that provided emergency housing to over 2000 vulnerable persons but fell short of the set goal of 15,000. It is projected that the homelessness problem will only get worse after the pandemic. With that in mind, we borrow from efforts like project Roomkey and suggest a solution that looks to improve upon these efforts to efficiently assign housing to the unhoused in our communities. The pandemic, together with the project Roomkey, shed light on the underlying supply demand mismatch that presents an opportunity for a matching mechanism solution to assigning housing options to the unhoused in a way that maximizes social welfare and minimizes susceptibility to strategic manipulation. Additionally, we argue that this automated solution would cut down on the amount of funding and personnel required for the assignment of housing to unhoused persons. Our solution is not intended to replace current solutions to homeless housing assignments but rather improve upon them. We can not postpone a proper solution to homelessness anymore, the time is now as the need for an efficient solution is most dire.


title: Simulating excited states of the Lipkin model on a quantum computer

abstract: We simulate the excited states of the Lipkin model using the recently proposed Quantum Equation of Motion (qEOM) method. The qEOM generalizes the EOM on classical computers and gives access to collective excitations based on quasi-boson operators $\hat{O}^\dagger_n(\alpha)$ of increasing configuration complexity $\alpha$. We show, in particular, that the accuracy strongly depends on the fermion to qubit encoding. Standard encoding leads to large errors, but the use of symmetries and the Gray code reduces the quantum resources and improves significantly the results on current noisy quantum devices. With this encoding scheme, we use IBM quantum machines to compute the energy spectrum for a system of $N=2, 3$ and $4$ particles and compare the accuracy against the exact solution. We found that the results of the approach with $\alpha = 2$, an analog of the second random phase approximation (SRPA), are, in principle, more accurate than with $\alpha = 1$, which corresponds to the random phase approximation (RPA), but the SRPA is more amenable to noise for large coupling strengths. Thus, the proposed scheme shows potential for achieving higher spectroscopic accuracy by implementations with higher configuration complexity, if a proper error mitigation method is applied.


title: Weightless Neural Networks for Efficient Edge Inference

abstract: Weightless Neural Networks (WNNs) are a class of machine learning model which use table lookups to perform inference. This is in contrast with Deep Neural Networks (DNNs), which use multiply-accumulate operations. State-of-the-art WNN architectures have a fraction of the implementation cost of DNNs, but still lag behind them on accuracy for common image recognition tasks. Additionally, many existing WNN architectures suffer from high memory requirements. In this paper, we propose a novel WNN architecture, BTHOWeN, with key algorithmic and architectural improvements over prior work, namely counting Bloom filters, hardware-friendly hashing, and Gaussian-based nonlinear thermometer encodings to improve model accuracy and reduce area and energy consumption. BTHOWeN targets the large and growing edge computing sector by providing superior latency and energy efficiency to comparable quantized DNNs. Compared to state-of-the-art WNNs across nine classification datasets, BTHOWeN on average reduces error by more than than 40% and model size by more than 50%. We then demonstrate the viability of the BTHOWeN architecture by presenting an FPGA-based accelerator, and compare its latency and resource usage against similarly accurate quantized DNN accelerators, including Multi-Layer Perceptron (MLP) and convolutional models. The proposed BTHOWeN models consume almost 80% less energy than the MLP models, with nearly 85% reduction in latency. In our quest for efficient ML on the edge, WNNs are clearly deserving of additional attention.


title: Modularity of the ABCD Random Graph Model with Community Structure

abstract: The Artificial Benchmark for Community Detection (ABCD) graph is a random graph model with community structure and power-law distribution for both degrees and community sizes. The model generates graphs with similar properties as the well-known LFR one, and its main parameter $\xi$ can be tuned to mimic its counterpart in the LFR model, the mixing parameter $\mu$. In this paper, we investigate various theoretical asymptotic properties of the ABCD model. In particular, we analyze the modularity function, arguably, the most important graph property of networks in the context of community detection. Indeed, the modularity function is often used to measure the presence of community structure in networks. It is also used as a quality function in many community detection algorithms, including the widely used Louvain algorithm.


title: Protection of quantum evolutions under parity-time symmetric non-Hermitian Hamiltonians by dynamical decoupling

abstract: Parity-time (PT) symmetric non-Hermitian Hamiltonians bring about many novel features and interesting applications such as quantum gates faster than those in Hermitian systems, and topological state transfer. The performance of evolutions under $\mathcal{PT}$-symmetric Hamiltonians is degraded by the inevitable noise and errors due to system-environment interaction and experimental imperfections. In contrast to Hermitian Hamiltonians, the fluctuations in dissipative beams that are utilized to generate non-Hermitian contributions in the PT-symmetric Hamiltonians cause additional errors. Here we achieve the protection of PT-symmetric Hamiltonians against noise acting along the qubit's quantization axis by combining quantum evolutions with dynamical decoupling sequences. We demonstrate the performance of our method by numerical simulations. Realistic noise sources and parameters are chosen including: constant detuning error, time-varying detuning noise and dissipative-beam noise. The fidelities of the protected evolutions are well above the unprotected ones under all the above situations. Our work paves the way for further studies and applications of non-Hermitian $\mathcal{PT}$-symmetric physics in noisy quantum systems.


title: MetaDT: Meta Decision Tree with Class Hierarchy for Interpretable Few-Shot Learning

abstract: Few-Shot Learning (FSL) is a challenging task, which aims to recognize novel classes with few examples. Recently, lots of methods have been proposed from the perspective of meta-learning and representation learning. However, few works focus on the interpretability of FSL decision process. In this paper, we take a step towards the interpretable FSL by proposing a novel meta-learning based decision tree framework, namely, MetaDT. In particular, the FSL interpretability is achieved from two aspects, i.e., a concept aspect and a visual aspect. On the concept aspect, we first introduce a tree-like concept hierarchy as FSL prior. Then, resorting to the prior, we split each few-shot task to a set of subtasks with different concept levels and then perform class prediction via a model of decision tree. The advantage of such design is that a sequence of high-level concept decisions that lead up to a final class prediction can be obtained, which clarifies the FSL decision process. On the visual aspect, a set of subtask-specific classifiers with visual attention mechanism is designed to perform decision at each node of the decision tree. As a result, a subtask-specific heatmap visualization can be obtained to achieve the decision interpretability of each tree node. At last, to alleviate the data scarcity issue of FSL, we regard the prior of concept hierarchy as an undirected graph, and then design a graph convolution-based decision tree inference network as our meta-learner to infer parameters of the decision tree. Extensive experiments on performance comparison and interpretability analysis show superiority of our MetaDT.


title: Constitutional Implementation of Affirmative Action Policies in India

abstract: India is home to a comprehensive affirmative action program that reserves a fraction of positions at governmental institutions for various disadvantaged groups. While there is a Supreme Court-endorsed mechanism to implement these reservation policies when all positions are identical, courts have refrained from endorsing explicit mechanisms when positions are heterogeneous. This lacunae has resulted in widespread adoption of unconstitutional mechanisms, countless lawsuits, and inconsistent court rulings. Formulating mandates in the landmark Supreme Court judgment Saurav Yadav (2020) as technical axioms, we show that the 2SMH-DA mechanism is uniquely suited to overcome these challenges.


title: Leptocline as a Shallow Substructure of Near-Surface Shear Layer in 3D Radiative Hydrodynamic Simulations

abstract: Understanding effects driven by rotation in the solar convection zone is essential for many problems related to solar activity, such as the formation of differential rotation, meridional circulation, and others. We analyze realistic 3D radiative hydrodynamics simulations of solar subsurface dynamics in the presence of rotation in a local domain 80 Mm wide and 25 Mm deep, located at 30 degrees latitude. The simulation results reveal the development of a shallow 10-Mm deep substructure of the Near-Surface Shear Layer (NSSL), characterized by a strong radial rotational gradient and self-organized meridional flows. This shallow layer ("leptocline") is located in the hydrogen ionization zone associated with enhanced anisotropic overshooting-type flows into a less unstable layer between the H and HeII ionization zones. We discuss current observational evidence of the presence of the leptocline and show that the radial variations of the differential rotation and meridional flow profiles obtained from the simulations in this layer qualitatively agree with helioseismic observations.


title: Enhanced mechanical heterogeneity of cell collectives due to temporal fluctuations in cell elasticity

abstract: Cells are dynamic systems characterized by temporal variations in biophysical properties such as stiffness and contractility. Recent studies show that the recruitment and release of actin filaments into and out of the cell cortex - a network of proteins underneath the cell membrane - leads to cell stiffening prior to division and softening immediately afterward. In three-dimensional (3D) cell collectives, it is unclear whether the stiffness change during division at the single-cell scale controls the spatial structure and dynamics at the multicellular scale. This is an important question to understand as cell stiffness variations play an important role in tissue spatial organization and cancer progression. Using a minimal 3D model incorporating cell birth, death, and cell-to-cell elastic and adhesive interactions, we investigate the effect of mechanical heterogeneity - variations in individual cell stiffnesses that make up the tumor cell collective - on tumor spatial organization and cell dynamics. We discover that spatial mechanical heterogeneity characterized by a spheroid core composed of stiffer cells and softer cells in the periphery emerge within dense 3D cell collectives, which may be a general feature of multicellular tumor growth. We show that heightened spatial mechanical heterogeneity enhances single-cell dynamics and volumetric tumor growth driven by fluctuations in cell elasticity. Our results could have important implications for understanding how spatiotemporal variations in single-cell stiffness determine tumor growth and spread.


title: Quantum simulation of a general anti-PT-symmetric Hamiltonian with a trapped ion qubit

abstract: Non-Hermitian systems satisfying parity-time (PT) symmetry have aroused considerable interest owing to their exotic features. Anti-PT symmetry is an important counterpart of the PT symmetry, and has been studied in various classical systems. Although a Hamiltonian with anti-PT symmetry only differs from its PT-symmetric counterpart in a global $\pm$ i phase, the ways they change information and energy with the enivronment are completely different, suggesting an essential different dynamics in anti-PT-symmetric systems from their PT -symmetric variants. Moreover, theortical works have shown that qubits with anti-PT-symmetric Hamiltonians (anti-PT-symmetric qubits) have superior decoherence properties over Hermitian qubits, as well as PT-symmetric ones. So far, the observation of anti-PT symmetry in individual quantum systems remains elusive. Here, we implement an anti-PT -symmetric Hamiltonian of a single qubit in a single trapped ion by a designed microwave and optical control-pulse sequence. We characterize the anti-PT phase transition by mapping out the eigenvalues at different dissipation rates. The full inforamtion of the quantum state is also obtained by quantum state tomography. Our work allows quantum simulation of genuine open-system feature of an anti-PT-symmetric system, which paves the way for utilizing non-Hermitian properties for quantum information processing.


title: Logarithmic Voronoi Cells for Gaussian Models

abstract: We extend the theory of logarithmic Voronoi cells to Gaussian statistical models. In general, a logarithmic Voronoi cell at a point on a Gaussian model is a convex set contained in its log-normal spectrahedron. We show that for models of ML degree one and linear covariance models the two sets coincide. In particular, they are equal for both directed and undirected graphical models. We introduce decomposition theory of logarithmic Voronoi cells for the latter family. We also study covariance models, for which logarithmic Voronoi cells are, in general, strictly contained in log-normal spectrahedra. We give an explicit description of logarithmic Voronoi cells for the bivariate correlation model and show that they are semi-algebraic sets. Finally, we state a conjecture that logarithmic Voronoi cells for unrestricted correlation models are not semi-algebraic.


title: PetsGAN: Rethinking Priors for Single Image Generation

abstract: Single image generation (SIG), described as generating diverse samples that have similar visual content with the given single image, is first introduced by SinGAN which builds a pyramid of GANs to progressively learn the internal patch distribution of the single image. It also shows great potentials in a wide range of image manipulation tasks. However, the paradigm of SinGAN has limitations in terms of generation quality and training time. Firstly, due to the lack of high-level information, SinGAN cannot handle the object images well as it does on the scene and texture images. Secondly, the separate progressive training scheme is time-consuming and easy to cause artifact accumulation. To tackle these problems, in this paper, we dig into the SIG problem and improve SinGAN by fully-utilization of internal and external priors. The main contributions of this paper include: 1) We introduce to SIG a regularized latent variable model. To the best of our knowledge, it is the first time to give a clear formulation and optimization goal of SIG, and all the existing methods for SIG can be regarded as special cases of this model. 2) We design a novel Prior-based end-to-end training GAN (PetsGAN) to overcome the problems of SinGAN. Our method gets rid of the time-consuming progressive training scheme and can be trained end-to-end. 3) We construct abundant qualitative and quantitative experiments to show the superiority of our method on both generated image quality, diversity, and the training speed. Moreover, we apply our method to other image manipulation tasks (e.g., style transfer, harmonization), and the results further prove the effectiveness and efficiency of our method.


title: The stabilizer bitorsors of the module and algebra harmonic coproducts are equal

abstract: In earlier work, we constructed a pair of "Betti" and "de Rham" Hopf algebras and a pair of module-coalgebras over this pair, as well as the bitorsors related to both structures (which will be called the "module" and "algebra" stabilizer bitorsors). We showed that Racinet's torsor constructed out of the double shuffle and regularization relations between multiple zeta values is essentially equal to the "module" stabilizer bitorsor, and that the latter is contained in the "algebra" stabilizer bitorsor. In this paper, we show the equality of the "algebra" and "module" stabilizer bitorsors. We reduce the proof to showing the equality of the associated "algebra" and "module" graded Lie algebras. The argument for showing this equality involves the relation of the "algebra" Lie algebra with the kernel of a linear map, the expression of this linear map as a composition of three linear maps, the relation of one of them with the "module" Lie algebra and the computation of the kernel of the other one by discrete topology arguments.


title: Overview of intermittency analysis in heavy-ion collisions

abstract: In this paper, a search for power-law fluctuations with fractality and intermittency analysis to explore the QCD phase diagram and the critical point is summarized. Experimental data on self-similar correlations and fluctuations with respect to the size of phase space volume in various high energy heavy-ion collisions are presented, with special emphasis on background subtraction and efficiency correction of the measurement. Phenomenological modelling and theoretical work on the subject are discussed. Finally, we highlight possible directions for future research.


title: The Best of Both Worlds: Reinforcement Learning with Logarithmic Regret and Policy Switches

abstract: In this paper, we study the problem of regret minimization for episodic Reinforcement Learning (RL) both in the model-free and the model-based setting. We focus on learning with general function classes and general model classes, and we derive results that scale with the eluder dimension of these classes. In contrast to the existing body of work that mainly establishes instance-independent regret guarantees, we focus on the instance-dependent setting and show that the regret scales logarithmically with the horizon $T$, provided that there is a gap between the best and the second best action in every state. In addition, we show that such a logarithmic regret bound is realizable by algorithms with $O(\log T)$ switching cost (also known as adaptivity complexity). In other words, these algorithms rarely switch their policy during the course of their execution. Finally, we complement our results with lower bounds which show that even in the tabular setting, we cannot hope for regret guarantees lower than $o(\log T)$.


title: Memory Complexity of Quantum Processes

abstract: Generic open quantum dynamics can be described by two seemingly very distinct approaches: a top down approach by considering an (unknown) environment coupled to the system and affects the observed dynamics of the system; or a bottom up approach which tries to build an open quantum evolution model from the observed data. The process tensor framework describes all the possible observations one could possibly make on a quantum system, however it is computationally inefficient and not predictive. Here we define the purified process tensor which 1) allows efficient tomography as well as prediction for future process and 2) naturally defines a stationary quantum process as well as a quantitative and easy-to-evaluate definition of the memory complexity, or the degree of non-Markovianity, for it. As such it allows to uncover the minimal open quantum evolution model hidden in the observed data, completing the second approach for understanding open quantum dynamics. The intimate connection between quantum processes and classical stochastic processes is drawn in the end.


title: Phased array beamforming methods for powering biomedical ultrasonic implants

abstract: Millimeter-scale implants using ultrasound for power and communication have been proposed for a range of deep-tissue applications, including neural recording and stimulation. However, published implementations have shown high sensitivity to misalignment with the external ultrasound transducer. Ultrasonic beamforming using a phased array to these implants can improve tolerance to misalignment, reduce implant volume, and allow multiple implants to be operated simultaneously in different locations. This paper details the design of a custom planar phased array ultrasound system, which is capable of steering and focusing ultrasound power within a 3D volume. Analysis and simulation is performed to determine the choice of array element pitch, with special attention given to maximizing the power available at the implant while meeting FDA limits for diagnostic ultrasound. Time reversal is proposed as a computationally simple approach to beamforming that is robust despite scattering and inhomogeneity of the acoustic medium. This technique is demonstrated both in active drive and pulse-echo modes, and it is experimentally compared with other beamforming techniques by measuring energy transfer efficiency. Simultaneous power delivery to multiple implants is also demonstrated.


title: Ensemble Domain Decomposition Algorithm for the Fully-mixed Random Stokes-Darcy Model with the Beavers-Joseph Interface Conditions

abstract: In this paper, an efficient ensemble domain decomposition algorithm is proposed for fast solving the fully-mixed random Stokes-Darcy model with the physically realistic Beavers-Joseph (BJ) interface conditions. We utilize the Monte Carlo method for the coupled model with random inputs to derive some deterministic Stokes-Darcy numerical models and use the idea of the ensemble to realize the fast computation of multiple problems. One remarkable feature of the algorithm is that multiple linear systems share a common coefficient matrix in each deterministic numerical model, which significantly reduces the computational cost and achieves comparable accuracy with the traditional methods. Moreover, by domain decomposition, we can decouple the Stokes-Darcy system into two smaller sub-physics problems naturally. Both mesh-dependent and mesh-independent convergence rates of the algorithm are rigorously derived by choosing suitable Robin parameters. Optimized Robin parameters are derived and analyzed to accelerate the convergence of the proposed algorithm. Especially, for small hydraulic conductivity in practice, the almost optimal geometric convergence can be obtained by finite element discretization. Finally, two groups of numerical experiments are conducted to validate and illustrate the exclusive features of the proposed algorithm.


title: Disperse rotation operator DRT and use in some stream ciphers

abstract: The rotation operator is frequently used in several stream ciphers, including HC-128, Rabbit, and Salsa20, the final candidates for eSTREAM. This is because the rotation operator (ROT) is simple but has very good dispersibility. In this paper, we propose a disperse rotation operator (DRT), which has the same structure as ROT but has better dispersibility. In addition, the use of DRT instead of ROT has shown that the quality of the output stream of all three stream ciphers was significantly improved. However, the use of DRT instead of ROT in the HC-128 stream cipher prevents the expansion of differential attacks based on LSB.


title: Low-Energy Excitations of Skyrmion Crystals in a Centrosymmetric Kondo-Lattice Magnet: Decoupled Spin-Charge Excitations and Nonreciprocity

abstract: We theoretically study spin and charge excitations of skyrmion crystals stabilized by conduction-electron-mediated magnetic interactions via spin-charge coupling in a centrosymmetric Kondo-lattice model by large-scale spin-dynamics simulations combined with the kernel polynomial method. We reveal clear segregation of spin and charge excitation channels and nonreciprocal nature of the spin excitations governed by the Fermi-surface geometry, which are unique to the skyrmion crystals in centrosymmetric itinerant hosts and can be a source of novel physical phenomena.


title: Analytical Second-Order Partial Derivatives of Rigid-Body Inverse Dynamics

abstract: Optimization-based robot control strategies often rely on first-order dynamics approximation methods, as in iLQR. Using second-order approximations of the dynamics is expensive due to the costly second-order partial derivatives of the dynamics with respect to the state and control. Current approaches for calculating these derivatives typically use automatic differentiation (AD) and chain-rule accumulation or finite-difference. In this paper, for the first time, we present analytical expressions for the second-order partial derivatives of inverse dynamics for open-chain rigid-body systems with floating base and multi-DoF joints. A new extension of spatial vector algebra is proposed that enables the analysis. A recursive algorithm with complexity of $\mathcal{O}(Nd^2)$ is also provided where $N$ is the number of bodies and $d$ is the depth of the kinematic tree. A comparison with AD in CasADi shows speedups of 1.5-3$\times$ for serial kinematic trees with $N> 5$, and a C++ implementation shows runtimes of $\approx$51$\mu s$ for a quadruped.


title: Existence and uniqueness of solutions to non-Abelian multiple vortex equations on graphs

abstract: Let $G=(V,E)$ be a connected finite graph. We study a system of non-Abelian multiple vortex equations on $G$. We established a necessary and sufficient condition for the existence and uniqueness of solutions to the non-Abelian multiple vortex equations.


title: Smoothness of the fundamental solution of Schr\"odinger equations with mild trapping

abstract: In this short note, smoothness of the fundamental solution of Schr\"odinger equations on a complete manifold is studied. It is shown that (1) the fundamental solution is smooth under "mild" trapping conditions; (2) there is a Riemannian manifold which is equal to Euclidean space outside a compact set such that the fundamental solution is not smooth.


title: The Dynamics of Q-learning in Population Games: a Physics-Inspired Continuity Equation Model

abstract: Although learning has found wide application in multi-agent systems, its effects on the temporal evolution of a system are far from understood. This paper focuses on the dynamics of Q-learning in large-scale multi-agent systems modeled as population games. We revisit the replicator equation model for Q-learning dynamics and observe that this model is inappropriate for our concerned setting. Motivated by this, we develop a new formal model, which bears a formal connection with the continuity equation in physics. We show that our model always accurately describes the Q-learning dynamics in population games across different initial settings of MASs and game configurations. We also show that our model can be applied to different exploration mechanisms, describe the mean dynamics, and be extended to Q-learning in 2-player and n-player games. Last but not least, we show that our model can provide insights into algorithm parameters and facilitate parameter tuning.


title: Strong light-matter interactions between gap plasmons and two-dimensional excitons at ambient condition in a deterministic way

abstract: Strong exciton-plasmon interaction between the layered two-dimensional (2D) semiconductors and gap plasmons shows a great potential to implement cavity quantum-electrodynamics in ambient condition. However, achieving a robust plasmon-exciton coupling with nanocavity is still very challenging, because the layer area is usually small with conventional approaches. Here, we report on a robust strong exciton-plasmon coupling between the gap mode of bowtie and the excitons in MoS$_2$ layers with gold-assisted mechanical exfoliation and the nondestructive wet transfer techniques for large-area layer. Benefiting from the ultrasmall mode volume and strong in-plane field, the estimated effective exciton number contributing to the coupling is largely reduced. With a corrected exciton transition dipole moment, the exciton numbers are extracted with 40 for the case of monolayer and 48 for 8 layers. Our work paves a way to realize the strong coupling with 2D materials with few excitons at room temperature.


title: NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimation

abstract: Estimating the accurate depth from a single image is challenging since it is inherently ambiguous and ill-posed. While recent works design increasingly complicated and powerful networks to directly regress the depth map, we take the path of CRFs optimization. Due to the expensive computation, CRFs are usually performed between neighborhoods rather than the whole graph. To leverage the potential of fully-connected CRFs, we split the input into windows and perform the FC-CRFs optimization within each window, which reduces the computation complexity and makes FC-CRFs feasible. To better capture the relationships between nodes in the graph, we exploit the multi-head attention mechanism to compute a multi-head potential function, which is fed to the networks to output an optimized depth map. Then we build a bottom-up-top-down structure, where this neural window FC-CRFs module serves as the decoder, and a vision transformer serves as the encoder. The experiments demonstrate that our method significantly improves the performance across all metrics on both the KITTI and NYUv2 datasets, compared to previous methods. Furthermore, the proposed method can be directly applied to panorama images and outperforms all previous panorama methods on the MatterPort3D dataset. Project page: https://weihaosky.github.io/newcrfs.


title: Understanding the impact of diffusion of CO in the astrochemical models

abstract: The mobility of lighter species on the surface of interstellar dust grains plays a crucial role in forming simple through complex molecules. Carbon monoxide is one of the most abundant molecules, its surface diffusion on the grain surface is essential to forming many molecules. Recent laboratory experiments found a diverse range of diffusion barriers for CO on the grain surface, their use can significantly impact the abundance of several molecules. The impact of different diffusion barriers of CO, in the astrochemical models, is studied to understand its effect on the abundance of solid CO and the species for which it is a reactant partner. A gas-grain network is used for three different physical conditions; cold-core and warm-up models with slow and fast heating rates. Two different ratios (0.3 and 0.5) between diffusion and desorption barrier are utilized for all the species. For each physical condition and ratio, six different models are run by varying diffusion barriers of CO. Solid CO abundance for the models with the lowest diffusion barrier yields less than 0.1% of water ice for cold clouds and a maximum of 0.4% for slow and fast warm-up models. Also, solid CO$_2$ in dense clouds is significantly overproduced (140 % of water). The abundance of H$_2$CO and CH$_3$OH showed an opposite trend, and HCOOH, CH$_3$CHO, NH$_2$CO, and CH$_3$COCH$_3$ are produced in lower quantities for models with low diffusion barriers for CO. Considerable variation in abundance is observed between models with the high and low diffusion barrier. Models with higher diffusion barriers provide a relatively better agreement with the observed abundances when compared with the models having lower diffusion barriers.


title: Security Analysis of Two Recent Pairing-Free Certificateless Two-Party Authenticated Key Agreement Protocols for Smart Grid

abstract: Smart grids are intelligent power transmission networks that monitor and control communication participants and grid nodes to ensure bidirectional flow of information and power between all nodes. To secure the smart grid, it is very important to design the key agreement protocol. The pairing-free certificateless two-party authenticated key agreement protocol has been widely studied and applied as a basic core protocol to protect the security of the smart grid. Until now, various protocols have been proposed, and these protocols are being introduced and operated not only in smart grid, but also in smart cities, healthcare, and vehicle ad hoc networks. In this paper, we analyzed the security properties of two recently proposed pairing-free certificateless two-party authenticated key agreement protocols for Smart grid. According to our analysis, these two protocols are insecure against basic impersonation attacks of malicious key-generator centers, man-in-the-middle attacks of malicious key generator centers, and key offset attacks. We also found and pointed out some errors in the descriptions of these protocols.


title: Large-scale Optimization of Partial AUC in a Range of False Positive Rates

abstract: The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC space, which may include the FPRs with no practical relevance in some applications. The partial AUC, as a generalization of the AUC, summarizes only the TPRs over a specific range of the FPRs and is thus a more suitable performance measure in many real-world situations. Although partial AUC optimization in a range of FPRs had been studied, existing algorithms are not scalable to big data and not applicable to deep learning. To address this challenge, we cast the problem into a non-smooth difference-of-convex (DC) program for any smooth predictive functions (e.g., deep neural networks), which allowed us to develop an efficient approximated gradient descent method based on the Moreau envelope smoothing technique, inspired by recent advances in non-smooth DC optimization. To increase the efficiency of large data processing, we used an efficient stochastic block coordinate update in our algorithm. Our proposed algorithm can also be used to minimize the sum of ranked range loss, which also lacks efficient solvers. We established a complexity of $\tilde O(1/\epsilon^6)$ for finding a nearly $\epsilon$-critical solution. Finally, we numerically demonstrated the effectiveness of our proposed algorithms for both partial AUC maximization and sum of ranked range loss minimization.


title: Energy Decomposition along Reaction Coordinate and Energy Weighted Reactive Flux: 1. Theory

abstract: A theoretical framework is proposed for an energy decomposition scheme along the reaction coordinate, in which the ensemble average of the potential energy weighted with reactive flux intensity is decomposed into energy components at the per-coordinate level. The decomposed energy quantity is demonstrated to be closely related to the free energy along the reaction coordinate and its connection to the emergent potential energy is provided. We also explore the property of the reactive flux weighted by the potential energy in the subspace of collective variables. A free energy analogue is then proposed in the subspace of collective variables and the directional derivative of this free energy analogue in the direction of the reactive flux is shown to be useful in the identification of the reaction coordinate and the minimum free energy path.


title: SMA-NBO: A Sequential Multi-Agent Planning with Nominal Belief-State Optimization in Target Tracking

abstract: In target tracking with mobile multi-sensor systems, sensor deployment impacts the observation capabilities and the resulting state estimation quality. Based on a partially observable Markov decision process (POMDP) formulation comprised of the observable sensor dynamics, unobservable target states, and accompanying observation laws, we present a distributed information-driven solution approach to the multi-agent target tracking problem, namely, sequential multi-agent nominal belief-state optimization (SMA-NBO). SMA-NBO seeks to minimize the expected tracking error via receding horizon control including a heuristic expected cost-to-go (HECTG). SMA-NBO incorporates a computationally efficient approximation of the target belief-state over the horizon. The agent-by-agent decision-making is capable of leveraging on-board (edge) compute for selecting (sub-optimal) target-tracking maneuvers exhibiting non-myopic cooperative fleet behavior. The optimization problem explicitly incorporates semantic information defining target occlusions from a world model. To illustrate the efficacy of our approach, a random occlusion forest environment is simulated. SMA-NBO is compared to other baseline approaches. The simulation results show SMA-NBO 1) maintains tracking performance and reduces the computational cost by replacing the calculation of the expected target trajectory with a single sample trajectory based on maximum a posteriori estimation; 2) generates cooperative fleet decision by sequentially optimizing single-agent policy with efficient usage of other agents' policy of intent; 3) aptly incorporates the multiple weighted trace penalty (MWTP) HECTG, which improves tracking performance with a computationally efficient heuristic.


title: The Velocity Statistics of Turbulent Clouds in the Presence of Gravity, Magnetic fields, Radiation, and Outflow Feedback

abstract: The interaction of turbulence, magnetic fields, self-gravity, and stellar feedback within molecular clouds is crucial for understanding star formation. We study the effects of self-gravity and outflow feedback on the properties of the turbulent velocity via the structure function over length scales from $\sim$ 0.01 pc to 2 pc. We analyze a series of three-dimensional, magnetohydrodynamical (MHD) simulations of star cluster formation. We find outflow feedback can change the scaling of velocity fluctuations but still roughly being in between Kolmogorov and Burgers turbulence. We observe that self-gravity and protostellar outflows increase the velocity fluctuations over all length scales. Outflows can amplify the velocity fluctuations by up to a factor of $\sim$7 on scales $\sim$ 0.01 - 0.2 pc and drive turbulence up to a scale of $\sim$ 1 pc. The amplified velocity fluctuations provide more support against gravity and enhance fragmentation on small scales. The self-gravity's effect is more significant on smaller dense clumps and it increases the fraction of the compressive velocity component up to a scale of $\sim$ 0.2 pc. However, outflow feedback drives both solenoidal and compressive modes, but it induces a higher fraction of solenoidal modes relative to compressive modes. Thus, with outflows, the dense core ends up with a slightly higher fraction of solenoidal modes. We find that the compressible fraction is fairly constant with about 1/3 on scales $\sim$ 0.1 - 0.2 pc. The combined effect of enhanced velocity dispersion and reduced compressive fraction contributes to a reduction in the star formation rate.


title: SoftGroup for 3D Instance Segmentation on Point Clouds

abstract: Existing state-of-the-art 3D instance segmentation methods perform semantic segmentation followed by grouping. The hard predictions are made when performing semantic segmentation such that each point is associated with a single class. However, the errors stemming from hard decision propagate into grouping that results in (1) low overlaps between the predicted instance with the ground truth and (2) substantial false positives. To address the aforementioned problems, this paper proposes a 3D instance segmentation method referred to as SoftGroup by performing bottom-up soft grouping followed by top-down refinement. SoftGroup allows each point to be associated with multiple classes to mitigate the problems stemming from semantic prediction errors and suppresses false positive instances by learning to categorize them as background. Experimental results on different datasets and multiple evaluation metrics demonstrate the efficacy of SoftGroup. Its performance surpasses the strongest prior method by a significant margin of +6.2% on the ScanNet v2 hidden test set and +6.8% on S3DIS Area 5 in terms of AP_50. SoftGroup is also fast, running at 345ms per scan with a single Titan X on ScanNet v2 dataset. The source code and trained models for both datasets are available at \url{https://github.com/thangvubk/SoftGroup.git}.


title: Probing the dark photon via polarized DIS scattering at the HERA and EIC

abstract: The dark photon is widely predicted in many new physics beyond the Standard Model. In this work, we propose to utilize the polarized lepton cross section in neutral current DIS process at the HERA and upcoming Electron-Ion Collider (EIC) to probe the properties of the dark photon. It shows that we can constrain the mixing parameter $\epsilon<0.02$ when the dark photon mass $m_{A_D}<10 ~{\rm GeV}$ at the HERA with polarized lepton beam and this bound is comparable to the limit from the unpolarized HERA data. With the help of high integrated luminosity and high electron beam polarization of the EIC, the upper limit of the $\epsilon$ could be further improved. Depending on the assumption of the systematic error of the cross section measurements, we obtain $\epsilon<0.01\sim 0.02$ for the mass region $m_{A_D}<10~{\rm GeV}$ under the integrated luminosity of $300~{\rm fb}^{-1}$. We also discuss the complementary roles between the cross section and the single-spin asymmetry measurements in probing the dark photon.


title: Measurable tilings by abelian group actions

abstract: Let $X$ be a measure space with a measure-preserving action $(g,x) \mapsto g \cdot x$ of an abelian group $G$. We consider the problem of understanding the structure of measurable tilings $F \odot A = X$ of $X$ by a measurable tile $A \subset X$ translated by a finite set $F \subset G$ of shifts, thus the translates $f \cdot A$, $f \in F$ partition $X$ up to null sets. Adapting arguments from previous literature, we establish a "dilation lemma" that asserts, roughly speaking, that $F \odot A = X$ implies $F^r \odot A = X$ for a large family of integer dilations $r$, and use this to establish a structure theorem for such tilings analogous to that established recently by the second and fourth authors. As applications of this theorem, we completely classify those random tilings of finitely generated abelian groups that are "factors of iid", and show that measurable tilings of a torus $\mathbb{T}^d$ can always be continuously (in fact linearly) deformed into a tiling with rational shifts, with particularly strong results in the low-dimensional cases $d=1,2$ (in particular resolving a conjecture of Conley, the first author, and Pikhurko in the $d=1$ case).


title: Restructuring in bimetallic core-shell nanoparticles: Real time observation

abstract: The formation process of core-shell bimetallic nanoparticles synthesized by sputtering onto a substrate is observed in real time using an originally developed acoustic technique. The technique enables us to evaluate the structural change of nanoparticles at room temperature without contacting the nanoparticles or substrate. In the experiments, the sputtering of metal A followed by metal B tended to form B-shell/A-core nanoparticles. However, in Pd-Au alloy system, notable restructuring occurred during synthesis, resulting in the formation of A-shell/B-core nanoparticles. The formation process is analyzed using the molecular dynamics simulation, revealing that this restructuring occurs on a short timescale, and high diffusivity of Au plays an important role.


title: Quantum Entanglement in the Sachdev-Ye-Kitaev Model and its Generalizations

abstract: Entanglement is one of the most important concepts in quantum physics. We review recent progress in understanding the quantum entanglement in many-body systems using large-$N$ solvable models: the Sachdev-Ye-Kitaev (SYK) model and its generalizations. We present the study of entanglement entropy in the original SYK Model using three different approaches: the exact diagonalization, the eigenstate thermalization hypothesis, and the path-integral representation. For coupled SYK models, the entanglement entropy shows linear growth and saturation at the thermal value. The saturation is related to replica wormholes in gravity. Finally, we consider the steady-state entanglement entropy of quantum many-body systems under repeated measurements. The traditional symmetry breaking in the enlarged replica space leads to the measurement-induced entanglement phase transition.


title: Physics-informed neural network solution of thermo-hydro-mechanical (THM) processes in porous media

abstract: Physics-Informed Neural Networks (PINNs) have received increased interest for forward, inverse, and surrogate modeling of problems described by partial differential equations (PDE). However, their application to multiphysics problem, governed by several coupled PDEs, present unique challenges that have hindered the robustness and widespread applicability of this approach. Here we investigate the application of PINNs to the forward solution of problems involving thermo-hydro-mechanical (THM) processes in porous media, which exhibit disparate spatial and temporal scales in thermal conductivity, hydraulic permeability, and elasticity. In addition, PINNs are faced with the challenges of the multi-objective and non-convex nature of the optimization problem. To address these fundamental issues, we: (1)~rewrite the THM governing equations in dimensionless form that is best suited for deep-learning algorithms; (2)~propose a sequential training strategy that circumvents the need for a simultaneous solution of the multiphysics problem and facilitates the task of optimizers in the solution search; and (3)~leverage adaptive weight strategies to overcome the stiffness in the gradient flow of the multi-objective optimization problem. Finally, we apply this framework to the solution of several synthetic problems in 1D and~2D.


title: Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding

abstract: Automatic ICD coding is defined as assigning disease codes to electronic medical records (EMRs). Existing methods usually apply label attention with code representations to match related text snippets. Unlike these works that model the label with the code hierarchy or description, we argue that the code synonyms can provide more comprehensive knowledge based on the observation that the code expressions in EMRs vary from their descriptions in ICD. By aligning codes to concepts in UMLS, we collect synonyms of every code. Then, we propose a multiple synonyms matching network to leverage synonyms for better code representation learning, and finally help the code classification. Experiments on the MIMIC-III dataset show that our proposed method outperforms previous state-of-the-art methods.


title: Ad2Attack: Adaptive Adversarial Attack on Real-Time UAV Tracking

abstract: Visual tracking is adopted to extensive unmanned aerial vehicle (UAV)-related applications, which leads to a highly demanding requirement on the robustness of UAV trackers. However, adding imperceptible perturbations can easily fool the tracker and cause tracking failures. This risk is often overlooked and rarely researched at present. Therefore, to help increase awareness of the potential risk and the robustness of UAV tracking, this work proposes a novel adaptive adversarial attack approach, i.e., Ad$^2$Attack, against UAV object tracking. Specifically, adversarial examples are generated online during the resampling of the search patch image, which leads trackers to lose the target in the following frames. Ad$^2$Attack is composed of a direct downsampling module and a super-resolution upsampling module with adaptive stages. A novel optimization function is proposed for balancing the imperceptibility and efficiency of the attack. Comprehensive experiments on several well-known benchmarks and real-world conditions show the effectiveness of our attack method, which dramatically reduces the performance of the most advanced Siamese trackers.