title: How Much More Data Do I Need? Estimating Requirements for Downstream Tasks

abstract: Given a small training data set and a learning algorithm, how much more data is necessary to reach a target validation or test performance? This question is of critical importance in applications such as autonomous driving or medical imaging where collecting data is expensive and time-consuming. Overestimating or underestimating data requirements incurs substantial costs that could be avoided with an adequate budget. Prior work on neural scaling laws suggest that the power-law function can fit the validation performance curve and extrapolate it to larger data set sizes. We find that this does not immediately translate to the more difficult downstream task of estimating the required data set size to meet a target performance. In this work, we consider a broad class of computer vision tasks and systematically investigate a family of functions that generalize the power-law function to allow for better estimation of data requirements. Finally, we show that incorporating a tuned correction factor and collecting over multiple rounds significantly improves the performance of the data estimators. Using our guidelines, practitioners can accurately estimate data requirements of machine learning systems to gain savings in both development time and data acquisition costs.


title: 2001 SN263 -- the contribution of their irregular shapes on the neighborhood dynamics

abstract: The first proposed Brazilian mission to deep space, the ASTER mission, has the triple asteroid system (153591) 2001 SN263 as a target. One of the mission's main goals is to analyze the physical and dynamical structures of the system to understand its origin and evolution. The present work aims to analyze how the asteroid's irregular shape interferes with the stability around the system. The results show that the irregular shape of the bodies plays an important role in the dynamics nearby the system. For instance, the perturbation due to the (153591) 2001 SN263 Alpha's shape affects the stability in the (153591) 2001 SN263 Gamma's vicinity. Similarly, the (153591) 2001 SN263 Beta's irregularity causes a significant instability in its nearby environment. As expected, the prograde case is the most unstable, while the retrograde scenario presents more stability. Additionally, we investigate how the solar radiation pressure perturbs particles of different sizes orbiting the triple system. We found that particles with a 10-50 cm radius could survive the radiation pressure for the retrograde case. Meanwhile, to resist solar radiation, the particles in prograde orbit must be larger than the particles in retrograde orbits, at least one order of magnitude.


title: Opinion formation process in a hierarchical society

abstract: In this work we study the formation of consensus in a hierarchical population. We derive the corresponding kinetic equations, and analyze the long time behaviour of their solutions for the case of finite number of hierarchical obtaining explicit formula for the consensus opinion.


title: Phase space analysis of nonlinear wave propagation in a bistable mechanical metamaterial with a defect

abstract: We study the dynamics of solitary waves traveling in a one-dimensional chain of bistable elements in the presence of a local inhomogeneity (defect). Numerical simulations reveal that depending upon its initial speed, an incoming solitary wave can get transmitted, captured or reflected upon interaction with the defect. The dynamics are dominated by energy exchange between the wave and a breather mode localized at the defect. We derive a reduced-order two degree of freedom Hamiltonian model for wave-breather interaction, and analyze it using dynamical systems techniques. Lobe dynamics analysis reveals the fine structure of phase space that leads to the complicated dynamics in this system. This work is a step towards developing a rational approach to defect engineering for manipulating nonlinear waves in mechanical metamaterials.


title: Determinant majorization and the work of Guo-Phong-Tong and Abja-Olive

abstract: The objective of this note is to establish the Determinant Majorization Formula $F(A)^{1\over N} \geq \det(A)^{1\over n}$ for all operators $F$ determined by an invariant Garding-Dirichlet polynomial of degree $N$ on symmetric $n \times n$ matrices. Here "invariant" means under the group O$(n)$, U$(n)$ or Sp$(n)$ when the matrices are real symmetric, Hermitian symmetric, or quaternionic symmetric respectively. This greatly expands the applicability of the recent work of Guo-Phong-Tong and Guo-Phong for differential equations on complex manifolds. It also relates to the work of Abja-Olive on interior regularity. Further applications to diagonal operators and to operators depending on the ordered eigenvalues are given. Examples showing the preciseness of the results are presented. For the application to Abja-Olive's work, and other comments in the paper, we establish some results for Garding-Dirichlet operators in appendices. One is an exhaustion lemma for the Garding cone. Another gives bounds for higher order derivatives, which result from their elegant expressions as functions of the Garding eigenvalues. There is also a discussion of the crucial assumption of the Central Ray Hypothesis.


title: Service Modeling and Delay Analysis of Packet Delivery over a Wireless Link

abstract: For delay analysis of packet delivery over a wireless link, several novel ideas are introduced. One is to construct an equivalent $G/G/1$ non-lossy queueing model to ease the analysis, enabled by exploiting empirical models of packet error rate, packet service time and packet loss rate obtained from measurement. The second is to exploit a classical queueing theory result to approximate the mean delay. For estimating the delay distribution, the newly developed stochastic network calculus (SNC) theory is made use of, forming the third idea. To enable this SNC based analysis, a stochastic service curve characterization of the link is introduced, relying on a packet service time model obtained from the empirical models. The focused link is a 802.15.4 wireless link. Extensive experimental investigation under a wide range of settings was conducted. The proposed ideas are validated with the experiment results. The validation confirms that the proposed approaches, integrating both empirical and analytical modes, are effective for service modeling and delay analysis. This suggests an integrated approach, now found previously, for quantitative understanding of the delay performance of packet delivery over a wireless link.


title: Preparations for Quantum Simulations of Quantum Chromodynamics in 1+1 Dimensions: (I) Axial Gauge

abstract: Tools necessary for quantum simulations of $1+1$ dimensional quantum chromodynamics are developed. When formulated in axial gauge and with two flavors of quarks, this system requires 12 qubits per spatial site with the gauge fields included via non-local interactions. Classical computations and D-Wave's quantum annealer Advantage are used to determine the hadronic spectrum, enabling a decomposition of the masses and a study of quark entanglement. Color edge states confined within a screening length of the end of the lattice are found. IBM's 7-qubit quantum computers, ibmq_jakarta and ibm_perth, are used to compute dynamics from the trivial vacuum in one-flavor QCD with one spatial site. More generally, the Hamiltonian and quantum circuits for time evolution of $1+1$ dimensional $SU(N_c)$ gauge theory with $N_f$ flavors of quarks are developed, and the resource requirements for large-scale quantum simulations are estimated.


title: DEFORMER: Coupling Deformed Localized Patterns with Global Context for Robust End-to-end Speech Recognition

abstract: Convolutional neural networks (CNN) have improved speech recognition performance greatly by exploiting localized time-frequency patterns. But these patterns are assumed to appear in symmetric and rigid kernels by the conventional CNN operation. It motivates the question: What about asymmetric kernels? In this study, we illustrate adaptive views can discover local features which couple better with attention than fixed views of the input. We replace depthwise CNNs in the Conformer architecture with a deformable counterpart, dubbed this "Deformer". By analyzing our best-performing model, we visualize both local receptive fields and global attention maps learned by the Deformer and show increased feature associations on the utterance level. The statistical analysis of learned kernel offsets provides an insight into the change of information in features with the network depth. Finally, replacing only half of the layers in the encoder, the Deformer improves +5.6% relative WER without a LM and +6.4% relative WER with a LM over the Conformer baseline on the WSJ eval92 set.


title: Are metrics measuring what they should? An evaluation of image captioning task metrics

abstract: Image Captioning is a current research task to describe the image content using the objects and their relationships in the scene. To tackle this task, two important research areas converge, artificial vision, and natural language processing. In Image Captioning, as in any computational intelligence task, the performance metrics are crucial for knowing how well (or bad) a method performs. In recent years, it has been observed that classical metrics based on n-grams are insufficient to capture the semantics and the critical meaning to describe the content in an image. Looking to measure how well or not the set of current and more recent metrics are doing, in this article, we present an evaluation of several kinds of Image Captioning metrics and a comparison between them using the well-known MS COCO dataset. The metrics were selected from the most used in prior works, they are those based on $n$-grams as BLEU, SacreBLEU, METEOR, ROGUE-L, CIDEr, SPICE, and those based on embeddings, such as BERTScore and CLIPScore. For this, we designed two scenarios; 1) a set of artificially build captions with several qualities, and 2) a comparison of some state-of-the-art Image Captioning methods. Interesting findings were found trying to answer the questions: Are the current metrics helping to produce high-quality captions? How do actual metrics compare to each other? What are the metrics really measuring?


title: ImageBox3: No-Server Tile Serving to Traverse Whole Slide Images on the Web

abstract: Whole slide imaging (WSI) has become the primary modality for digital pathology data. However, due to the size and high-resolution nature of these images, they are generally only accessed in smaller sections or tiles via specialized platforms, most of which require extensive setup and/or costly infrastructure. These platforms typically also need a copy of the images to be locally available to them, potentially causing issues with data governance and provenance. To address these concerns, we developed ImageBox3, an in-browser tiling mechanism to enable zero-footprint traversal of remote WSI data. All computation is performed client-side without compromising user governance, operating public and private images alike as long as the storage service supports HTTP range requests (standard in Cloud storage and most web servers). ImageBox3 thus removes significant hurdles to WSI operation and effective collaboration, allowing for the sort of democratized analytical tools needed to establish participative, FAIR digital pathology data commons. Availability: code - https://github.com/episphere/imagebox3; fig1 (live) - https://episphere.github.io/imagebox3/demo/scriptTag ; fig2 (live) - https://episphere.github.io/imagebox3/demo/serviceWorker ; fig 3 (live) - https://observablehq.com/@prafulb/imagebox3-in-observable .


title: A weak version of Mond's conjecture

abstract: We prove that a map germ $f:(\mathbb{C}^n,S)\to(\mathbb{C}^{n+1},0)$ with isolated instability is stable if and only if $\mu_I(f)=0$, where $\mu_I(f)$ is the image Milnor number defined by Mond. In a previous paper we proved this result with the additional assumption that $f$ has corank one. The proof here is also valid for corank $\ge 2$, provided that $(n,n+1)$ are nice dimensions in Mather's sense (so $\mu_I(f)$ is well defined). Our result can be seen as a weak version of a conjecture by Mond, which says that the $\mathcal{A}_e$-codimension of $f$ is $\le \mu_I(f)$, with equality if $f$ is weighted homogeneous. As an application, we deduce that the bifurcation set of a versal unfolding of $f$ is a hypersurface.


title: Probing via Prompting

abstract: Probing is a popular method to discern what linguistic information is contained in the representations of pre-trained language models. However, the mechanism of selecting the probe model has recently been subject to intense debate, as it is not clear if the probes are merely extracting information or modeling the linguistic property themselves. To address this challenge, this paper introduces a novel model-free approach to probing, by formulating probing as a prompting task. We conduct experiments on five probing tasks and show that our approach is comparable or better at extracting information than diagnostic probes while learning much less on its own. We further combine the probing via prompting approach with attention head pruning to analyze where the model stores the linguistic information in its architecture. We then examine the usefulness of a specific linguistic property for pre-training by removing the heads that are essential to that property and evaluating the resulting model's performance on language modeling.


title: Sea: A lightweight data-placement library for Big Data scientific computing

abstract: The recent influx of open scientific data has contributed to the transitioning of scientific computing from compute intensive to data intensive. Whereas many Big Data frameworks exist that minimize the cost of data transfers, few scientific applications integrate these frameworks or adopt data-placement strategies to mitigate the costs. Scientific applications commonly rely on well-established command-line tools that would require complete reinstrumentation in order to incorporate existing frameworks. We developed Sea as a means to enable data-placement strategies for scientific applications executing on HPC clusters without the need to reinstrument workflows. Sea leverages GNU C library interception to intercept POSIX-compliant file system calls made by the applications. We designed a performance model and evaluated the performance of Sea on a synthetic data-intensive application processing a representative neuroimaging dataset (the Big Brain). Our results demonstrate that Sea significantly improves performance, up to a factor of 3$\times$.


title: Domain-Independent Deception: Definition, Taxonomy and the Linguistic Cues Debate

abstract: Internet-based economies and societies are drowning in deceptive attacks. These attacks take many forms, such as fake news, phishing, and job scams, which we call "domains of deception." Machine-learning and natural-language-processing researchers have been attempting to ameliorate this precarious situation by designing domain-specific detectors. Only a few recent works have considered domain-independent deception. We collect these disparate threads of research and investigate domain-independent deception along four dimensions. First, we provide a new computational definition of deception and formalize it using probability theory. Second, we break down deception into a new taxonomy. Third, we analyze the debate on linguistic cues for deception and supply guidelines for systematic reviews. Fourth, we provide some evidence and some suggestions for domain-independent deception detection.


title: Machine Learning in Access Control: A Taxonomy and Survey

abstract: An increasing body of work has recognized the importance of exploiting machine learning (ML) advancements to address the need for efficient automation in extracting access control attributes, policy mining, policy verification, access decisions, etc. In this work, we survey and summarize various ML approaches to solve different access control problems. We propose a novel taxonomy of the ML model's application in the access control domain. We highlight current limitations and open challenges such as lack of public real-world datasets, administration of ML-based access control systems, understanding a black-box ML model's decision, etc., and enumerate future research directions.


title: Characterizing low-frequency qubit noise

abstract: Fluctuations of the qubit frequencies are one of the major problems to overcome on the way to scalable quantum computers. Of particular importance are fluctuations with the correlation time that exceeds the decoherence time due to decay and dephasing by fast processes. The statistics of the fluctuations can be characterized by measuring the correlators of the outcomes of periodically repeated Ramsey measurements. This work suggests a method that allows describing qubit dynamics during repeated measurements in the presence of evolving noise. It made it possible, in particular, to evaluate the two-time correlator for the noise from two-level systems and obtain two- and three-time correlators for a Gaussian noise. The explicit expressions for the correlators are compared with simulations. A significant difference of the three-time correlators for the noise from two-level systems and for a Gaussian noise is demonstrated. Strong broadening of the distribution of the outcomes of Ramsey measurements, with a possible fine structure, is found for the data acquisition time comparable to the noise correlation time.


title: Cluster folding analysis for the 6,7Li and 20Ne + 24Mg nuclear systems

abstract: The experimentally available angular distributions (ADs) for 6,7Li and 20Ne ions elastically scattered from a 24Mg target are reanalyzed using various nuclear potentials based on phenomenological and microscopic approaches. The ADs for the 6Li + 24Mg system at energies Elab = 20, 88, and 240 MeV are considered, as are the ADs for the 7Li + 24Mg system at Elab = 20, 34, and 88 MeV, and the ADs for the 20Ne + 24Mg systems at Elab = 50, 60, 80, 90, and 100 MeV. Special emphasis is placed on the (d + {\alpha}) and (t + {\alpha}) cluster structures of 6Li and 7Li weakly bound projectiles, which appear at relatively low energies of 1.4737 and 2.468 MeV, respectively. Furthermore, the 20Ne stable nucleus is a candidate to reveal the {\alpha} + 16O cluster structure at an energy of 4.73 MeV. These systems are analyzed within the framework of the cluster folding model by taking into consideration the aforementioned cluster nature of the (6Li, 7Li, and 20Ne) projectiles. The adopted approaches fairly reproduced the experimental ADs.


title: Anomaly-aware multiple instance learning for rare anemia disorder classification

abstract: Deep learning-based classification of rare anemia disorders is challenged by the lack of training data and instance-level annotations. Multiple Instance Learning (MIL) has shown to be an effective solution, yet it suffers from low accuracy and limited explainability. Although the inclusion of attention mechanisms has addressed these issues, their effectiveness highly depends on the amount and diversity of cells in the training samples. Consequently, the poor machine learning performance on rare anemia disorder classification from blood samples remains unresolved. In this paper, we propose an interpretable pooling method for MIL to address these limitations. By benefiting from instance-level information of negative bags (i.e., homogeneous benign cells from healthy individuals), our approach increases the contribution of anomalous instances. We show that our strategy outperforms standard MIL classification algorithms and provides a meaningful explanation behind its decisions. Moreover, it can denote anomalous instances of rare blood diseases that are not seen during the training phase.


title: Synthetic Polarization Maps of an Outflow Zone from Magnetohydrodynamic Simulations

abstract: The canonical theory of star formation in a magnetized environment predicts the formation of hourglass-shaped magnetic fields during the prestellar collapse phase. In protostellar cores, recent observations reveal complex and strongly distorted magnetic fields in the inner regions that are sculpted by rotation and outflows. We conduct resistive, nonideal magnetohydrodynamic (MHD) simulations of a protostellar core and employ the radiative transfer code POLARIS to produce synthetic polarization segment maps. Comparison of our mock-polarization maps based on the toroidal-dominated magnetic field in the outflow zone with the observed polarization vectors of SiO lines in Orion Source I shows a reasonable agreement when the magnetic axis is tilted at an angle $\theta = 15^{\circ}$ with respect to the plane-of-sky and if the SiO lines have a net polarization parallel to the local magnetic field. Although the observed polarization is from SiO lines and our synthetic maps are due to polarized dust emission, a comparison is useful and allows us to resolve the ambiguity of whether the line polarization is parallel or perpendicular to the local magnetic field direction.


title: Discrete Tree Flows via Tree-Structured Permutations

abstract: While normalizing flows for continuous data have been extensively researched, flows for discrete data have only recently been explored. These prior models, however, suffer from limitations that are distinct from those of continuous flows. Most notably, discrete flow-based models cannot be straightforwardly optimized with conventional deep learning methods because gradients of discrete functions are undefined or zero. Previous works approximate pseudo-gradients of the discrete functions but do not solve the problem on a fundamental level. In addition to that, backpropagation can be computationally burdensome compared to alternative discrete algorithms such as decision tree algorithms. Our approach seeks to reduce computational burden and remove the need for pseudo-gradients by developing a discrete flow based on decision trees -- building upon the success of efficient tree-based methods for classification and regression for discrete data. We first define a tree-structured permutation (TSP) that compactly encodes a permutation of discrete data where the inverse is easy to compute; thus, we can efficiently compute the density value and sample new data. We then propose a decision tree algorithm to build TSPs that learns the tree structure and permutations at each node via novel criteria. We empirically demonstrate the feasibility of our method on multiple datasets.


title: Electron gases in toroidal shells: mode coupling and state functions

abstract: Eigenvalues and wave functions describing free electron gases in toroidal shells are determined using a basis set expansion natural to the system geometry. Couplings between azimuthal and poloidal modes are found to be appreciable at lower values of ${m_\phi}$, modifying single particle density distributions within the shells. Thermodynamic state functions are calculated and contrasted with those of a solid toroidal volume.


title: The structure of homogeneous Riemannian manifolds with nullity

abstract: We find new conditions that the existence of nullity of the curvature tensor of an irreducible homogeneous space $M=G/H$ imposes on the Lie algebra $\mathfrak g$ of $G$ and on the Lie algebra $\tilde{\mathfrak g}$ of the full isometry group of $M$. Namely, we prove that there exists a transvection of $M$ in the direction of any element of the nullity, possibly by enlarging the presentation group $G$. Moreover, we prove that these transvections generate an abelian ideal of $\tilde{\mathfrak g}$. These results constitute a substantial improvement on the structure theory developed in \cite{DOV}. In addition we construct examples of homogeneous Riemannian spaces with non-trivial nullity, where $G$ is a non-solvable group, answering a natural open question. Such examples admit (locally homogeneous) compact quotients. In the case of co-nullity $3$ we give an explicit description of the isometry group of any homogeneouslocally irreducible Riemannian manifold with nullity.


title: Vector Field-based Collision Avoidance for Moving Obstacles with Time-Varying Elliptical Shape

abstract: This paper presents an algorithm for local motion planning in environments populated by moving elliptical obstacles whose velocity, shape and size are fully known but may change with time. We base the algorithm on a collision avoidance vector field (CAVF) that aims to steer an agent to a desired final state whose motion is described by a double integrator kinematic model. In addition to handling multiple obstacles, the method is applicable in bounded environments for more realistic applications (e.g., motion planning inside a building). We also incorporate a method to deal with agents whose control input is limited so that they safely navigate around the obstacles. To showcase our approach, extensive simulations results are presented in 2D and 3D scenarios.


title: Analysis of the dynamics induced by a competition index in a heterogeneous population of plants: from an individual-based model to a macroscopic model

abstract: Competition indices are models frequently used in ecology to account for the impact of density and resource distribution on the growth of a plant population. They allow to define simple individual-based models, by integrating information relatively easy to collect at the population scale, which are generalized to a macroscopic scale by mean-field limit arguments. Nevertheless, up to our knowledge, few works have studied under which conditions on the competition index or on the initial configuration of the population the passage from the individual scale to the population scale is mathematically guaranteed. We consider in this paper a competition index commonly used in the literature, expressed as an average over the population of a pairwise potential depending on a measure of plants' sizes and their respective distances. In line with the literature on mixed-effect models, the population is assumed to be heterogeneous, with inter-individual variability of growth parameters. Sufficient conditions on the initial configuration are given so that the population dynamics, taking the form of a system of non-linear differential equations, is well defined. The mean-field distribution associated with an infinitely crowded population is then characterized by the characteristic flow, and the convergence towards this distribution for an increasing population size is also proved. The dynamics of the heterogeneous population is illustrated by numerical simulations, using a Lagrangian scheme to visualize the mean-field dynamics.


title: Human-AI Guidelines in Practice: Leaky Abstractions as an Enabler in Collaborative Software Teams

abstract: In conventional software development, user experience (UX) designers and engineers collaborate through separation of concerns (SoC): designers create human interface specifications, and engineers build to those specifications. However, we argue that Human-AI systems thwart SoC because human needs must shape the design of the AI interface, the underlying AI sub-components, and training data. How do designers and engineers currently collaborate on AI and UX design? To find out, we interviewed 21 industry professionals (UX researchers, AI engineers, data scientists, and managers) across 14 organizations about their collaborative work practices and associated challenges. We find that hidden information encapsulated by SoC challenges collaboration across design and engineering concerns. Practitioners describe inventing ad-hoc representations exposing low-level design and implementation details (which we characterize as leaky abstractions) to "puncture" SoC and share information across expertise boundaries. We identify how leaky abstractions are employed to collaborate at the AI-UX boundary and formalize a process of creating and using leaky abstractions.


title: Federated Split GANs

abstract: Mobile devices and the immense amount and variety of data they generate are key enablers of machine learning (ML)-based applications. Traditional ML techniques have shifted toward new paradigms such as federated (FL) and split learning (SL) to improve the protection of user's data privacy. However, these paradigms often rely on server(s) located in the edge or cloud to train computationally-heavy parts of a ML model to avoid draining the limited resource on client devices, resulting in exposing device data to such third parties. This work proposes an alternative approach to train computationally-heavy ML models in user's devices themselves, where corresponding device data resides. Specifically, we focus on GANs (generative adversarial networks) and leverage their inherent privacy-preserving attribute. We train the discriminative part of a GAN with raw data on user's devices, whereas the generative model is trained remotely (e.g., server) for which there is no need to access sensor true data. Moreover, our approach ensures that the computational load of training the discriminative model is shared among user's devices-proportional to their computation capabilities-by means of SL. We implement our proposed collaborative training scheme of a computationally-heavy GAN model in real resource-constrained devices. The results show that our system preserves data privacy, keeps a short training time, and yields same accuracy of model training in unconstrained devices (e.g., cloud). Our code can be found on https://github.com/YukariSonz/FSL-GAN


title: TT-PINN: A Tensor-Compressed Neural PDE Solver for Edge Computing

abstract: Physics-informed neural networks (PINNs) have been increasingly employed due to their capability of modeling complex physics systems. To achieve better expressiveness, increasingly larger network sizes are required in many problems. This has caused challenges when we need to train PINNs on edge devices with limited memory, computing and energy resources. To enable training PINNs on edge devices, this paper proposes an end-to-end compressed PINN based on Tensor-Train decomposition. In solving a Helmholtz equation, our proposed model significantly outperforms the original PINNs with few parameters and achieves satisfactory prediction with up to 15$\times$ overall parameter reduction.


title: Plan Execution for Multi-Agent Path Finding with Indoor Quadcopters

abstract: We study the planning and acting phase for the problem of multi-agent path finding (MAPF) in this paper. MAPF is a problem of navigating agents from their start positions to specified individual goal positions so that agents do not collide with each other. Specifically we focus on executing MAPF plans with a group of Crazyflies, small indoor quadcopters . We show how to modify the existing continuous time conflict-based search algorithm (CCBS) to produce plans that are suitable for execution with the quadcopters. The acting phase uses the the Loco positioning system to check if the plan is executed correctly. Our finding is that the CCBS algorithm allows for extensions that can produce safe plans for quadcopters, namely cylindrical protection zone around each quadcopter can be introduced at the planning level.


title: Topic Community Based Temporal Expertise for Question Routing

abstract: Question Routing in Community-based Question Answering websites aims at recommending newly posted questions to potential users who are most likely to provide "accepted answers". Most of the existing approaches predict users' expertise based on their past question answering behavior and the content of new questions. However, these approaches suffer from challenges in three aspects: 1) sparsity of users' past records results in lack of personalized recommendation that at times does not match users' interest or domain expertise, 2) modeling based on all questions and answers content makes periodic updates computationally expensive, and 3) while CQA sites are highly dynamic, they are mostly considered as static. This paper proposes a novel approach to QR that addresses the above challenges. It is based on dynamic modeling of users' activity on topic communities. Experimental results on three real-world datasets demonstrate that the proposed model significantly outperforms competitive baseline models


title: Cryptography with Certified Deletion

abstract: We propose a new, unifying framework that yields an array of cryptographic primitives with certified deletion. These primitives enable a party in possession of a quantum ciphertext to generate a classical certificate that the encrypted plaintext has been information-theoretically deleted, and cannot be recovered even given unbounded computational resources. - For X \in {public-key, attribute-based, fully-homomorphic, witness, timed-release}, our compiler converts any (post-quantum) X encryption to X encryption with certified deletion. In addition, we compile statistically-binding commitments to statistically-binding commitments with certified everlasting hiding. As a corollary, we also obtain statistically-sound zero-knowledge proofs for QMA with certified everlasting zero-knowledge assuming statistically-binding commitments. - We also obtain a strong form of everlasting security for two-party and multi-party computation in the dishonest majority setting. While simultaneously achieving everlasting security against all parties in this setting is known to be impossible, we introduce everlasting security transfer (EST). This enables any one party (or a subset of parties) to dynamically and certifiably information-theoretically delete other participants' data after protocol execution. We construct general-purpose secure computation with EST assuming statistically-binding commitments, which can be based on one-way functions or pseudorandom quantum states. We obtain our results by developing a novel proof technique to argue that a bit b has been information-theoretically deleted from an adversary's view once they output a valid deletion certificate, despite having been previously information-theoretically determined by the ciphertext they held in their view. This technique may be of independent interest.


title: Attention Guided Network for Salient Object Detection in Optical Remote Sensing Images

abstract: Due to the extreme complexity of scale and shape as well as the uncertainty of the predicted location, salient object detection in optical remote sensing images (RSI-SOD) is a very difficult task. The existing SOD methods can satisfy the detection performance for natural scene images, but they are not well adapted to RSI-SOD due to the above-mentioned image characteristics in remote sensing images. In this paper, we propose a novel Attention Guided Network (AGNet) for SOD in optical RSIs, including position enhancement stage and detail refinement stage. Specifically, the position enhancement stage consists of a semantic attention module and a contextual attention module to accurately describe the approximate location of salient objects. The detail refinement stage uses the proposed self-refinement module to progressively refine the predicted results under the guidance of attention and reverse attention. In addition, the hybrid loss is applied to supervise the training of the network, which can improve the performance of the model from three perspectives of pixel, region and statistics. Extensive experiments on two popular benchmarks demonstrate that AGNet achieves competitive performance compared to other state-of-the-art methods. The code will be available at https://github.com/NuaaYH/AGNet.


title: Universal Domain Adaptive Object Detector

abstract: Universal domain adaptive object detection (UniDAOD)is more challenging than domain adaptive object detection (DAOD) since the label space of the source domain may not be the same as that of the target and the scale of objects in the universal scenarios can vary dramatically (i.e, category shift and scale shift). To this end, we propose US-DAF, namely Universal Scale-Aware Domain Adaptive Faster RCNN with Multi-Label Learning, to reduce the negative transfer effect during training while maximizing transferability as well as discriminability in both domains under a variety of scales. Specifically, our method is implemented by two modules: 1) We facilitate the feature alignment of common classes and suppress the interference of private classes by designing a Filter Mechanism module to overcome the negative transfer caused by category shift. 2) We fill the blank of scale-aware adaptation in object detection by introducing a new Multi-Label Scale-Aware Adapter to perform individual alignment between the corresponding scale for two domains. Experiments show that US-DAF achieves state-of-the-art results on three scenarios (i.e, Open-Set, Partial-Set, and Closed-Set) and yields 7.1% and 5.9% relative improvement on benchmark datasets Clipart1k and Watercolor in particular.


title: A note on asymptotic profiles for the thermoelastic plate system

abstract: We investigate the Cauchy problem for the thermoelastic plate system associated with Newton's law of cooling, where optimal growth ($n\leqslant 4$) or decay ($n\geqslant 5$) estimates and asymptotic profiles of solutions for large-time are studied. Especially, the additional lower-order term in the temperature equation weakens decay rates of the vertical displacement, and leads to a new leading term comparing with the classical thermoelastic plates.


title: FDVTS's Solution for 2nd COV19D Competition on COVID-19 Detection and Severity Analysis

abstract: This paper presents our solution for the 2nd COVID-19 Competition, occurring in the framework of the AIMIA Workshop in the European Conference on Computer Vision (ECCV 2022). In our approach, we employ an effective 3D Contrastive Mixup Classification network for COVID-19 diagnosis on chest CT images, which is composed of contrastive representation learning and mixup classification. For the COVID-19 detection challenge, our approach reaches 0.9245 macro F1 score on 484 validation CT scans, which significantly outperforms the baseline method by 16.5%. In the COVID-19 severity detection challenge, our approach achieves 0.7186 macro F1 score on 61 validation samples, which also surpasses the baseline by 8.86%.


title: Extremal graphs for odd-ballooning of bipartite graphs

abstract: Given a graph $H$ and an odd integer $t$ ($t\geq 3$), the odd-ballooning of $H$, denoted by $H(t)$, is the graph obtained from replacing each edge of $H$ by an odd cycle of length at least $t$ where the new vertices of the cycles are all distinct. In this paper, we determine the range of Tur\'{a}n numbers for odd-ballooning of bipartite graphs when $t\geq 5$. As applications, we may deduce the Tur\'{a}n numbers for odd-ballooning of stars, paths and even cycles.


title: GP22: A Car Styling Dataset for Automotive Designers

abstract: An automated design data archiving could reduce the time wasted by designers from working creatively and effectively. Though many datasets on classifying, detecting, and instance segmenting on car exterior exist, these large datasets are not relevant for design practices as the primary purpose lies in autonomous driving or vehicle verification. Therefore, we release GP22, composed of car styling features defined by automotive designers. The dataset contains 1480 car side profile images from 37 brands and ten car segments. It also contains annotations of design features that follow the taxonomy of the car exterior design features defined in the eye of the automotive designer. We trained the baseline model using YOLO v5 as the design feature detection model with the dataset. The presented model resulted in an mAP score of 0.995 and a recall of 0.984. Furthermore, exploration of the model performance on sketches and rendering images of the car side profile implies the scalability of the dataset for design purposes.


title: First Price Auction is $1-1/e^2$ Efficient

abstract: We prove that the {\sf PoA} of {\sf First Price Auctions} is $1 - 1/e^2 \approx 0.8647$, closing the gap between the best known bounds $[0.7430,\, 0.8689]$.


title: PReGAN: Answer Oriented Passage Ranking with Weakly Supervised GAN

abstract: Beyond topical relevance, passage ranking for open-domain factoid question answering also requires a passage to contain an answer (answerability). While a few recent studies have incorporated some reading capability into a ranker to account for answerability, the ranker is still hindered by the noisy nature of the training data typically available in this area, which considers any passage containing an answer entity as a positive sample. However, the answer entity in a passage is not necessarily mentioned in relation with the given question. To address the problem, we propose an approach called \ttt{PReGAN} for Passage Reranking based on Generative Adversarial Neural networks, which incorporates a discriminator on answerability, in addition to a discriminator on topical relevance. The goal is to force the generator to rank higher a passage that is topically relevant and contains an answer. Experiments on five public datasets show that \ttt{PReGAN} can better rank appropriate passages, which in turn, boosts the effectiveness of QA systems, and outperforms the existing approaches without using external data.


title: Inclusive $J/\psi$ photoproduction at the ILC within the framework of non-relativistic QCD

abstract: Based on the non-relativistic quantum chromodynamics factorization framework, we study the inclusive $J/\psi$ photoproduction at the future high energy $e^+e^-$ collider, International Linear Collider(ILC), where the initial photons come from the back-scattering of laser and electron (positron). The intermediate states, $c\bar{c}$$({}^3\!S_1^{[\textbf{1}]}$,${}^1\!S_0^{[\textbf{8}]}$,${}^3\!S_1^{[\textbf{8}]}$,${}^3\!P_{0,1,2}^{[\textbf{8}]})$, and resolved photoproduction processes are considered. Numerical results show that the cross section of $J/\psi$ photoproduction at the ILC could be very large, and the single resolved process via $c\bar{c}({}^1\!S_0^{[\textbf{8}]})$ intermediate state dominates primarily the production. We also present various kinematic distributions for $J/\psi$ photoproduction. Combining the high luminosity of the collision, $J/\psi$ photoproduction at the ILC shall provide a good platform to test the NRQCD factorization.


title: Covariant Density Functional Theory with Localized Exchange Terms

abstract: A new density-dependent point-coupling covariant density functional PCF-PK1 is proposed, where the exchange terms of the four-fermion terms are local and are taken into account with the Fierz transformation. The coupling constants of the PCF-PK1 functional are determined by empirical saturation properties and ab initio equation of state and proton-neutron Dirac mass splittings for nuclear matter as well as the ground-state properties of selected spherical nuclei. The success of the PCF-PK1 is illustrated with properties of the infinite nuclear matter and finite nuclei including the ground-state properties and the Gamow-Teller resonances. In particular, the PCFPK1 eliminates the spurious shell closures at Z = 58 and Z = 92, which exist commonly in many covariant density functionals without exchange terms. Moreover, the Gamow-Teller resonances are nicely reproduced without any adjustable parameters, and this demonstrates that a self-consistent description for the Gamow-Teller resonances can be achieved with the localized exchange terms in the PCF-PK1. ?


title: opPINN: Physics-Informed Neural Network with operator learning to approximate solutions to the Fokker-Planck-Landau equation

abstract: We propose a hybrid framework opPINN: physics-informed neural network (PINN) with operator learning for approximating the solution to the Fokker-Planck-Landau (FPL) equation. The opPINN framework is divided into two steps: Step 1 and Step 2. After the operator surrogate models are trained during Step 1, PINN can effectively approximate the solution to the FPL equation during Step 2 by using the pre-trained surrogate models. The operator surrogate models greatly reduce the computational cost and boost PINN by approximating the complex Landau collision integral in the FPL equation. The operator surrogate models can also be combined with the traditional numerical schemes. It provides a high efficiency in computational time when the number of velocity modes becomes larger. Using the opPINN framework, we provide the neural network solutions for the FPL equation under the various types of initial conditions, and interaction models in two and three dimensions. Furthermore, based on the theoretical properties of the FPL equation, we show that the approximated neural network solution converges to the a priori classical solution of the FPL equation as the pre-defined loss function is reduced.

categories: math.NA cs.AI cs.LG cs.NA physics.comp-ph


title: Strong bulk Dzyaloshinskii-Moriya interaction in composition-uniform centrosymmetric magnetic single layers

abstract: Dzyaloshinskii-Moriya interaction (DMI) is the key ingredient of chiral spintronic phenomena and the emerging technologies based on such phenomena. A nonzero DMI usually occurs at magnetic interfaces or within non-centrosymmetric single crystals. Here, we report the observation of a strong unexpected DMI within a centrosymmetric polycrystalline ferromagnet that has neither a crystal inversion symmetry breaking nor a composition gradient. This DMI is a bulk effect, increases with the thickness of the magnetic layer, and is insensitive to the symmetry of the interfaces or the neighboring materials. We observe a total DMI strength that is a factor of >2 greater than the highest interfacial DMI in the literature. This DMI most likely arises from the strong spin-orbit coupling, strong orbital hybridization, and a "hidden" long-range asymmetry in the material. Our discovery of the strong unconventional bulk DMI in centrosymmetric, composition-uniform magnetic single layers provide fundamental building blocks for the emerging field of spintronics and will stimulate the exploitation of unconventional spin-orbit phenomena in a wide range of materials.


title: Three approaches to chiral form interactions

abstract: We briefly review and critically compare three approaches to constructing Lagrangian theories of self-interacting Abelian chiral form fields with manifest Lorentz invariance. The first approach relies on the original ideas of Pasti, Sorokin, and Tonin (PST) and has been explored since the late 1990s. The second approach was introduced by Ashoke Sen in 2015. The third approach has been developed over the last few years in the works of the present authors and other collaborators and may be called the 'clone field' formalism since it features an auxiliary 'clone' of the gauge field sector. We argue that this last approach shares the attractive features of the other two while avoiding their respective shortcomings. Like in Sen's approach, within the clone field formalism, arbitrary interactions can be straightforwardly included in any number of dimensions (treating interactions becomes very difficult in the PST formalism in dimensions greater than 6). Like in the PST approach, all the auxiliary fields are gauged away on-shell (while in Sen's approach, they merely decouple from the physical fields but remain dynamical).


title: Rank-Based Filter Pruning for Real-Time UAV Tracking

abstract: Unmanned aerial vehicle (UAV) tracking has wide potential applications in such as agriculture, navigation, and public security. However, the limitations of computing resources, battery capacity, and maximum load of UAV hinder the deployment of deep learning-based tracking algorithms on UAV. Consequently, discriminative correlation filters (DCF) trackers stand out in the UAV tracking community because of their high efficiency. However, their precision is usually much lower than trackers based on deep learning. Model compression is a promising way to narrow the gap (i.e., effciency, precision) between DCF- and deep learning- based trackers, which has not caught much attention in UAV tracking. In this paper, we propose the P-SiamFC++ tracker, which is the first to use rank-based filter pruning to compress the SiamFC++ model, achieving a remarkable balance between efficiency and precision. Our method is general and may encourage further studies on UAV tracking with model compression. Extensive experiments on four UAV benchmarks, including UAV123@10fps, DTB70, UAVDT and Vistrone2018, show that P-SiamFC++ tracker significantly outperforms state-of-the-art UAV tracking methods.


title: SESS: Saliency Enhancing with Scaling and Sliding

abstract: High-quality saliency maps are essential in several machine learning application areas including explainable AI and weakly supervised object detection and segmentation. Many techniques have been developed to generate better saliency using neural networks. However, they are often limited to specific saliency visualisation methods or saliency issues. We propose a novel saliency enhancing approach called SESS (Saliency Enhancing with Scaling and Sliding). It is a method and model agnostic extension to existing saliency map generation methods. With SESS, existing saliency approaches become robust to scale variance, multiple occurrences of target objects, presence of distractors and generate less noisy and more discriminative saliency maps. SESS improves saliency by fusing saliency maps extracted from multiple patches at different scales from different areas, and combines these individual maps using a novel fusion scheme that incorporates channel-wise weights and spatial weighted average. To improve efficiency, we introduce a pre-filtering step that can exclude uninformative saliency maps to improve efficiency while still enhancing overall results. We evaluate SESS on object recognition and detection benchmarks where it achieves significant improvement. The code is released publicly to enable researchers to verify performance and further development. Code is available at: https://github.com/neouyghur/SESS


title: $Z$ boson decays $Z\rightarrow{{l_i}^{\pm}{l_j}^{\mp}}$ and Higgs boson decays $h\rightarrow{{l_i}^{\pm}{l_j}^{\mp}}$ with lepton flavor violation in a $U(1)$ extension of the MSSM

abstract: $U(1)_X$SSM is the extension of the minimal supersymmetric standard model (MSSM) and its local gauge group is $SU(3)_C\times SU(2)_L \times U(1)_Y \times U(1)_X$. We study lepton flavor violating (LFV) decays $Z\rightarrow{{l_i}^{\pm}{l_j}^{\mp}}$($Z\rightarrow e{\mu}$, $Z\rightarrow e{\tau}$, and $Z\rightarrow {\mu}{\tau}$) and $h\rightarrow{{l_i}^{\pm}{l_j}^{\mp}}$($h\rightarrow e{\mu}$, $h\rightarrow e{\tau}$, and $h\rightarrow {\mu}{\tau}$), in this model. In the numerical results, the branching ratios of $Z\rightarrow{{l_i}^{\pm}{l_j}^{\mp}}$ are from $10^{-9}$ to $10^{-13}$ and the branching ratios of $h\rightarrow{{l_i}^{\pm}{l_j}^{\mp}}$ are from $10^{-3}$ to $10^{-9}$, which can approach the present experimental upper bounds. Based on the latest experimental data, we analyze the influence of different sensitive parameters on the branching ratio, and make reasonable predictions for future experiments. The main sensitive parameters and LFV sources are the non-diagonal elements corresponding to the initial and final generations of leptons, which can be seen from the numerical analysis.


title: A Generative Framework for Personalized Learning and Estimation: Theory, Algorithms, and Privacy

abstract: A distinguishing characteristic of federated learning is that the (local) client data could have statistical heterogeneity. This heterogeneity has motivated the design of personalized learning, where individual (personalized) models are trained, through collaboration. There have been various personalization methods proposed in literature, with seemingly very different forms and methods ranging from use of a single global model for local regularization and model interpolation, to use of multiple global models for personalized clustering, etc. In this work, we begin with a generative framework that could potentially unify several different algorithms as well as suggest new algorithms. We apply our generative framework to personalized estimation, and connect it to the classical empirical Bayes' methodology. We develop private personalized estimation under this framework. We then use our generative framework for learning, which unifies several known personalized FL algorithms and also suggests new ones; we propose and study a new algorithm AdaPeD based on a Knowledge Distillation, which numerically outperforms several known algorithms. We also develop privacy for personalized learning methods with guarantees for user-level privacy and composition. We numerically evaluate the performance as well as the privacy for both the estimation and learning problems, demonstrating the advantages of our proposed methods.


title: Vision-and-Language Pretraining

abstract: With the burgeoning amount of data of image-text pairs and diversity of Vision-and-Language (V\&L) tasks, scholars have introduced an abundance of deep learning models in this research domain. Furthermore, in recent years, transfer learning has also shown tremendous success in Computer Vision for tasks such as Image Classification, Object Detection, etc., and in Natural Language Processing for Question Answering, Machine Translation, etc. Inheriting the spirit of Transfer Learning, research works in V\&L have devised multiple pretraining techniques on large-scale datasets in order to enhance the performance of downstream tasks. The aim of this article is to provide a comprehensive revision of contemporary V\&L pretraining models. In particular, we categorize and delineate pretraining approaches, along with the summary of state-of-the-art vision-and-language pretrained models. Moreover, a list of training datasets and downstream tasks is supplied to further polish the perspective into V\&L pretraining. Lastly, we decided to take a further step to discuss numerous directions for future research.


title: Approximating Discontinuous Nash Equilibrial Values of Two-Player General-Sum Differential Games

abstract: Finding Nash equilibrial policies for two-player differential games requires solving Hamilton-Jacobi-Isaacs (HJI) PDEs. Self-supervised learning has been used to approximate solutions of such PDEs while circumventing the curse of dimensionality. However, this method fails to learn discontinuous PDE solutions due to its sampling nature, leading to poor safety performance of the resulting controllers in robotics applications when player rewards are discontinuous. This paper investigates two potential solutions to this problem: a hybrid method that leverages both supervised Nash equilibria and the HJI PDE, and a value-hardening method where a sequence of HJIs are solved with a gradually hardening reward. We compare these solutions using the resulting generalization and safety performance in two vehicle interaction simulation studies with 5D and 9D state spaces, respectively. Results show that with informative supervision (e.g., collision and near-collision demonstrations) and the low cost of self-supervised learning, the hybrid method achieves better safety performance than the supervised, self-supervised, and value hardening approaches on equal computational budget. Value hardening fails to generalize in the higher-dimensional case without informative supervision. Lastly, we show that the neural activation function needs to be continuously differentiable for learning PDEs and its choice can be case dependent.


title: Hyperbolic fringe signal for twin impurity quasiparticle interference

abstract: We study the quasiparticle interference (QPI) pattern emanating from a pair of adjacent impurities on the surface of a gapped superconductor (SC). We find that hyperbolic fringes (HF) in the QPI signal can appear due to the loop contribution of the two-impurity scattering, where the location of the two impurities are the hyperbolic focus points. For a single pocket Fermiology, an HF pattern signals chiral SC order for non-magnetic impurities and requires magnetic impurities for non-chiral SC. For a multi-pocket scenario, a sign-changing order parameter such as $s_{\pm}$-wave likewise yields an HF signature. We discuss twin impurity QPI as a new tool to complement the analysis of superconducting order from local spectroscopy.


title: Revisiting sterile neutrino dark matter in gauged $U(1)_{B-L}$ model

abstract: We reexamine sterile neutrino dark matter in gauged $U(1)_{B-L}$ model. Improvements have been made by tracing and careful evaluation of the evolution of the number densities of sterile neutrinos $N$ and extra neutral gauge bosons $Z'$. As a result, the cosmologically-interesting gauge coupling of $U(1)_{B-L}$ for freeze-in sterile neutrinos turns out to be smaller than the values reported in the literature. This avoids the overproduction of $Z'$ so that it is consistent with the big bang nucleosynthesis and the cosmic microwave background constraints on the effective number of neutrino species. Similarly, the free-streaming length constraints exclude a large parameter space derived in previous studies. In addition to known freeze-in pair production of $N$ from the standard model fermion pairs, we find the case that $N$ is dominantly produced from a pair of $Z'$ at the temperature characterized by the $B-L$ breaking scalar mass. Thus, the naive truncation of the $U(1)_{B-L}$ scalar contribution made in the literature is not valid.


title: Green's function and Pointwise Behavior of the One-Dimensional Vlasov-Maxwell-Boltzmann System

abstract: The pointwise space-time behavior of the Green's function of the one-dimensional Vlasov-Maxwell-Boltzmann (VMB) system is studied in this paper. It is shown that the Green's function consists of the macroscopic diffusive waves and Huygens waves with the speed $\pm \sqrt{5/3}$ at low-frequency, the hyperbolic waves with the speed $\pm 1$ at high-frequency, the singular kinetic and leading short waves, and the remaining term decaying exponentially in space and time. Note that these high-frequency hyperbolic waves are completely new and can not be observed for the Boltzmann equation and the Vlasov-Poisson-Boltzmann system. In addition, we establish the pointwise space-time estimate of the global solution to the nonlinear VMB system based on the Green's function. Compared to the Boltzmann equation and the Vlasov-Poisson-Boltzmann system, some new ideas are introduced to overcome the difficulties caused by the coupling effects of the transport of particles and the rotating of electro-magnetic fields, and investigate the new hyperbolic waves and singular leading short waves.


title: Netcast: Low-Power Edge Computing with WDM-defined Optical Neural Networks

abstract: This paper analyzes the performance and energy efficiency of Netcast, a recently proposed optical neural-network architecture designed for edge computing. Netcast performs deep neural network inference by dividing the computational task into two steps, which are split between the server and (edge) client: (1) the server employs a wavelength-multiplexed modulator array to encode the network's weights onto an optical signal in an analog time-frequency basis, and (2) the client obtains the desired matrix-vector product through modulation and time-integrated detection. The simultaneous use of wavelength multiplexing, broadband modulation, and integration detection allows large neural networks to be run at the client by effectively pushing the energy and memory requirements back to the server. The performance and energy efficiency are fundamentally limited by crosstalk and detector noise, respectively. We derive analytic expressions for these limits and perform numerical simulations to verify these bounds.


title: Object-Level Targeted Selection via Deep Template Matching

abstract: Retrieving images with objects that are semantically similar to objects of interest (OOI) in a query image has many practical use cases. A few examples include fixing failures like false negatives/positives of a learned model or mitigating class imbalance in a dataset. The targeted selection task requires finding the relevant data from a large-scale pool of unlabeled data. Manual mining at this scale is infeasible. Further, the OOI are often small and occupy less than 1% of image area, are occluded, and co-exist with many semantically different objects in cluttered scenes. Existing semantic image retrieval methods often focus on mining for larger sized geographical landmarks, and/or require extra labeled data, such as images/image-pairs with similar objects, for mining images with generic objects. We propose a fast and robust template matching algorithm in the DNN feature space, that retrieves semantically similar images at the object-level from a large unlabeled pool of data. We project the region(s) around the OOI in the query image to the DNN feature space for use as the template. This enables our method to focus on the semantics of the OOI without requiring extra labeled data. In the context of autonomous driving, we evaluate our system for targeted selection by using failure cases of object detectors as OOI. We demonstrate its efficacy on a large unlabeled dataset with 2.2M images and show high recall in mining for images with small-sized OOI. We compare our method against a well-known semantic image retrieval method, which also does not require extra labeled data. Lastly, we show that our method is flexible and retrieves images with one or more semantically different co-occurring OOI seamlessly.


title: 3D Part Assembly Generation with Instance Encoded Transformer

abstract: It is desirable to enable robots capable of automatic assembly. Structural understanding of object parts plays a crucial role in this task yet remains relatively unexplored. In this paper, we focus on the setting of furniture assembly from a complete set of part geometries, which is essentially a 6-DoF part pose estimation problem. We propose a multi-layer transformer-based framework that involves geometric and relational reasoning between parts to update the part poses iteratively. We carefully design a unique instance encoding to solve the ambiguity between geometrically-similar parts so that all parts can be distinguished. In addition to assembling from scratch, we extend our framework to a new task called in-process part assembly. Analogous to furniture maintenance, it requires robots to continue with unfinished products and assemble the remaining parts into appropriate positions. Our method achieves far more than 10% improvements over the current state-of-the-art in multiple metrics on the public PartNet dataset. Extensive experiments and quantitative comparisons demonstrate the effectiveness of the proposed framework.


title: CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning

abstract: Program synthesis or code generation aims to generate a program that satisfies a problem specification. Recent approaches using large-scale pretrained language models (LMs) have shown promising results, yet they have some critical limitations. In particular, they often follow a standard supervised fine-tuning procedure to train a code generation model only from the pairs of natural-language problem descriptions and ground-truth programs. Such paradigm largely ignores some important but potentially useful signals in the problem specification such as unit tests, which thus often results in poor performance when solving complex unseen coding tasks. To address the limitations, we propose "CodeRL", a new framework for program synthesis tasks through pretrained LMs and deep reinforcement learning (RL). Specifically, during training, we treat the code-generating LM as an actor network, and introduce a critic network that is trained to predict the functional correctness of generated programs and provide dense feedback signals to the actor. During inference, we introduce a new generation procedure with a critical sampling strategy that allows a model to automatically regenerate programs based on feedback from example unit tests and critic scores. For the model backbones, we extended the encoder-decoder architecture of CodeT5 with enhanced learning objectives, larger model sizes, and better pretraining data. Our method not only achieves new SOTA results on the challenging APPS benchmark, but also shows strong zero-shot transfer capability with new SOTA results on the simpler MBPP benchmark.


title: A Radiation Tolerant Proton Detector Based on MAPbBr3 single crystal

abstract: The performance and radiation tolerance of the proton detector based on MAPbBr3 perovskite single crystal are investigated here with 3MeV protons. The detector can monitor fluence rate and dose quantificationally at a low applied bias electric field(0.01$V/{\mu}m$) within a dose range of 45 kGy. The detector can also be worked at zero bias due to the Dember effect. The dark current of the detector reduced to 20% of the initial value after being irradiated with protons to a total fluence of $7.3\times 10^{13} p/cm^2$ (1 MGy), however, it can be recovered at room temperature within hours. These results suggest that this kind of detector has a promising application in proton therapy and proton imaging etc.


title: Energy-filtered random-phase states as microcanonical thermal pure quantum states

abstract: We propose a method to calculate finite-temperature properties of a quantum many-body system for a microcanonical ensemble by introducing a pure quantum state named here an energy-filtered random-phase state, which is also a potentially promising application of near-term quantum computers. In our formalism, a microcanonical ensemble is specified by two parameters, i.e., the energy of the system and its associated energy window. Accordingly, the density of states is expressed as a sum of Gaussians centered at the target energy with its spread corresponding to the width of the energy window. We then show that the thermodynamic quantities such as entropy and temperature are calculated by evaluating the trace of the time-evolution operator and the trace of the time-evolution operator multiplied by the Hamiltonian of the system. We also describe how these traces can be evaluated using random diagonal-unitary circuits appropriate to quantum computation. The pure quantum state representing our microcanonical ensemble is related to a state of the form introduced by Wall and Neuhauser for the filter diagonalization method [M. R. Wall and D. Neuhauser, J. Chem. Phys. 102, 8011 (1995)], and therefore we refer to it as an energy-filtered random-phase state. The energy-filtered random-phase state is essentially a Fourier transform of a time-evolved state whose initial state is prepared as a random-phase state, and the cut-off time in the time-integral for the Fourier transform sets the inverse of the width of the energy window. The proposed method is demonstrated numerically by calculating thermodynamic quantities for the one-dimensional spin-1/2 Heisenberg model on small clusters up to 28 qubits, showing that the method is most efficient for the target energy around which the dense distribution of energy eigenstates is found.


title: On A Mallows-type Model For (Ranked) Choices

abstract: We consider a preference learning setting where every participant chooses an ordered list of $k$ most preferred items among a displayed set of candidates. (The set can be different for every participant.) We identify a distance-based ranking model for the population's preferences and their (ranked) choice behavior. The ranking model resembles the Mallows model but uses a new distance function called Reverse Major Index (RMJ). We find that despite the need to sum over all permutations, the RMJ-based ranking distribution aggregates into (ranked) choice probabilities with simple closed-form expression. We develop effective methods to estimate the model parameters and showcase their generalization power using real data, especially when there is a limited variety of display sets.


title: A Unified Meta-Learning Framework for Dynamic Transfer Learning

abstract: Transfer learning refers to the transfer of knowledge or information from a relevant source task to a target task. However, most existing works assume both tasks are sampled from a stationary task distribution, thereby leading to the sub-optimal performance for dynamic tasks drawn from a non-stationary task distribution in real scenarios. To bridge this gap, in this paper, we study a more realistic and challenging transfer learning setting with dynamic tasks, i.e., source and target tasks are continuously evolving over time. We theoretically show that the expected error on the dynamic target task can be tightly bounded in terms of source knowledge and consecutive distribution discrepancy across tasks. This result motivates us to propose a generic meta-learning framework L2E for modeling the knowledge transferability on dynamic tasks. It is centered around a task-guided meta-learning problem with a group of meta-pairs of tasks, based on which we are able to learn the prior model initialization for fast adaptation on the newest target task. L2E enjoys the following properties: (1) effective knowledge transferability across dynamic tasks; (2) fast adaptation to the new target task; (3) mitigation of catastrophic forgetting on historical target tasks; and (4) flexibility in incorporating any existing static transfer learning algorithms. Extensive experiments on various image data sets demonstrate the effectiveness of the proposed L2E framework.


abstract: Let $\mathfrak{a}$ be a proper ideal of a commutative noetherian ring $R$ and $d$ a positive integer. We answer Hartshorne's question on cofinite complexes completely in the cases $\mathrm{dim}R=d$ or $\mathrm{dim}R/\mathfrak{a}=d-1$ or $\mathrm{ara}(\mathfrak{a})=d-1$, show that if $d\leq2$ then an $R$-complex $X\in\mathrm{D}_\sqsubset(R)$ is $\mathfrak{a}$-cofinite if and only if each homology module $\mathrm{H}_i(X)$ is $\mathfrak{a}$-cofinite; if $\mathfrak{a}$ is a perfect ideal and $R$ is regular local with $d\leq2$ then an $R$-complex $X\in\mathrm{D}(R)$ is $\mathfrak{a}$-cofinite if and only if $\mathrm{H}_i(X)$ is $\mathfrak{a}$-cofinite for every $i\in\mathbb{Z}$; if $d\geq3$ then for an $R$-complex $X$ of $\mathfrak{a}$-cofinite $R$-modules, each $\mathrm{H}_i(X)$ is $\mathfrak{a}$-cofinite if and only if $\mathrm{Ext}^j_R(R/\mathfrak{a},\mathrm{coker}d_i)$ are finitely generated for $j\leq d-2$. We also study cofiniteness of local cohomology $\mathrm{H}^i_\mathfrak{a}(X)$ for an $R$-complex $X\in\mathrm{D}_\sqsubset(R)$ in the above cases. The crucial step to achieve these is to recruit the technique of spectral sequences.


title: Effect of boundary conditions on a high-performance isolation hexapod platform

abstract: Isolation of spacecraft microvibrations is essential for the successful deployment of instruments relying on high-precision pointing. Hexapod platforms represent a promising solution, but the difficulties associated with attaining desirable 3D dynamics within acceptable mass and complexity budgets have led to a minimal practical adoption. This paper addresses the influence of strut boundary conditions (BCs) on system-level mechanical disturbance suppression. Inherent limitations of the traditional all-rotational joint configuration are highlighted and shown to originate in link mass and rotational inertia. A pin-slider BC alternative is proposed and analytically proven to alleviate them in both 2D and 3D. The advantages of the new BC hold for arbitrary parallel manipulators and are demonstrated for several hexapod geometries through numerical tests. A configuration with favourable performance is suggested. Finally, a novel planar joint that allows the physical realisation of the proposed BC is described and validated. Consequently, this work enables the development of platforms for microvibration attenuation that do not require active control.


title: A note on knot Floer homology of satellite knots with (1,1)-patterns

abstract: We prove that if $P$ is a $(1,1)$-pattern knot, the two inequalities $\dim \widehat{HFK} (P(K)) \geqslant \dim \widehat{HFK} (P(U))$ and $\dim \widehat{HFK} (P(K)) \geqslant \dim \widehat{HFK} (K)$ hold for the unknot $U\subset S^3$ and any companion knot $K\subset S^3$.


title: Quiet Sun Center to Limb Variation of the Linear Polarization Observed by CLASP2 Across the Mg II h & k Lines

abstract: The CLASP2 (Chromospheric LAyer SpectroPolarimeter 2) sounding rocket mission was launched on 2019 April 11. CLASP2 measured the four Stokes parameters of the Mg II h & k spectral region around 2800 Angstroms along a 200 arcsecond slit at three locations on the solar disk, achieving the first spatially and spectrally resolved observations of the solar polarization in this near ultraviolet region. The focus of the work presented here is the center-to-limb variation of the linear polarization across these resonance lines, which is produced by the scattering of anisotropic radiation in the solar atmosphere. The linear polarization signals of the Mg II h & k lines are sensitive to the magnetic field from the low to the upper chromosphere through the Hanle and magneto-optical effects. We compare the observations to theoretical predictions from radiative transfer calculations in unmagnetized semi-empirical models, arguing that magnetic fields and horizontal inhomogeneities are needed to explain the observed polarization signals and spatial variations. This comparison is an important step in both validating and refining our understanding of the physical origin of these polarization signatures, and also in paving the way toward future space telescopes for probing the magnetic fields of the solar upper atmosphere via ultraviolet spectropolarimetry.


title: Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization

abstract: We consider minimizing a twice-differentiable, $L$-smooth, and $\mu$-strongly convex objective $\phi$ over an $n\times n$ positive semidefinite matrix $M\succeq0$, under the assumption that the minimizer $M^{\star}$ has low rank $r^{\star}\ll n$. Following the Burer--Monteiro approach, we instead minimize the nonconvex objective $f(X)=\phi(XX^{T})$ over a factor matrix $X$ of size $n\times r$. This substantially reduces the number of variables from $O(n^{2})$ to as few as $O(n)$ and also enforces positive semidefiniteness for free, but at the cost of giving up the convexity of the original problem. In this paper, we prove that if the search rank $r\ge r^{\star}$ is overparameterized by a constant factor with respect to the true rank $r^{\star}$, namely as in $r>\frac{1}{4}(L/\mu-1)^{2}r^{\star}$, then despite nonconvexity, local optimization is guaranteed to globally converge from any initial point to the global optimum. This significantly improves upon a previous rank overparameterization threshold of $r\ge n$, which is known to be sharp if $\phi$ is allowed to be nonsmooth and/or non-strongly convex, but would increase the number of variables back up to $O(n^{2})$. Conversely, without rank overparameterization, we prove that such a global guarantee is possible if and only if $\phi$ is almost perfectly conditioned, with a condition number of $L/\mu<3$. Therefore, we conclude that a small amount of overparameterization can lead to large improvements in theoretical guarantees for the nonconvex Burer--Monteiro factorization.


title: Penny Wise and Pound Foolish: Quantifying the Risk of Unlimited Approval of ERC20 Tokens on Ethereum

abstract: The prosperity of decentralized finance motivates many investors to profit via trading their crypto assets on decentralized applications (DApps for short) of the Ethereum ecosystem. Apart from Ether (the native cryptocurrency of Ethereum), many ERC20 (a widely used token standard on Ethereum) tokens obtain vast market value in the ecosystem. Specifically, the approval mechanism is used to delegate the privilege of spending users' tokens to DApps. By doing so, the DApps can transfer these tokens to arbitrary receivers on behalf of the users. To increase the usability, unlimited approval is commonly adopted by DApps to reduce the required interaction between them and their users. However, as shown in existing security incidents, this mechanism can be abused to steal users' tokens. In this paper, we present the first systematic study to quantify the risk of unlimited approval of ERC20 tokens on Ethereum. Specifically, by evaluating existing transactions up to 31st July 2021, we find that unlimited approval is prevalent (60%, 15.2M/25.4M) in the ecosystem, and 22% of users have a high risk of their approved tokens for stealing. After that, we investigate the security issues that are involved in interacting with the UIs of 22 representative DApps and 9 famous wallets to prepare the approval transactions. The result reveals the worrisome fact that all DApps request unlimited approval from the front-end users and only 10% (3/31) of UIs provide explanatory information for the approval mechanism. Meanwhile, only 16% (5/31) of UIs allow users to modify their approval amounts. Finally, we take a further step to characterize the user behavior into five modes and formalize the good practice, i.e., on-demand approval and timely spending, towards securely spending approved tokens. However, the evaluation result suggests that only 0.2% of users follow the good practice to mitigate the risk.


title: A deep cascade of ensemble of dual domain networks with gradient-based T1 assistance and perceptual refinement for fast MRI reconstruction

abstract: Deep learning networks have shown promising results in fast magnetic resonance imaging (MRI) reconstruction. In our work, we develop deep networks to further improve the quantitative and the perceptual quality of reconstruction. To begin with, we propose reconsynergynet (RSN), a network that combines the complementary benefits of independently operating on both the image and the Fourier domain. For a single-coil acquisition, we introduce deep cascade RSN (DC-RSN), a cascade of RSN blocks interleaved with data fidelity (DF) units. Secondly, we improve the structure recovery of DC-RSN for T2 weighted Imaging (T2WI) through assistance of T1 weighted imaging (T1WI), a sequence with short acquisition time. T1 assistance is provided to DC-RSN through a gradient of log feature (GOLF) fusion. Furthermore, we propose perceptual refinement network (PRN) to refine the reconstructions for better visual information fidelity (VIF), a metric highly correlated to radiologists opinion on the image quality. Lastly, for multi-coil acquisition, we propose variable splitting RSN (VS-RSN), a deep cascade of blocks, each block containing RSN, multi-coil DF unit, and a weighted average module. We extensively validate our models DC-RSN and VS-RSN for single-coil and multi-coil acquisitions and report the state-of-the-art performance. We obtain a SSIM of 0.768, 0.923, 0.878 for knee single-coil-4x, multi-coil-4x, and multi-coil-8x in fastMRI. We also conduct experiments to demonstrate the efficacy of GOLF based T1 assistance and PRN.


title: Features Based Adaptive Augmentation for Graph Contrastive Learning

abstract: Self-Supervised learning aims to eliminate the need for expensive annotation in graph representation learning, where graph contrastive learning (GCL) is trained with the self-supervision signals containing data-data pairs. These data-data pairs are generated with augmentation employing stochastic functions on the original graph. We argue that some features can be more critical than others depending on the downstream task, and applying stochastic function uniformly, will vandalize the influential features, leading to diminished accuracy. To fix this issue, we introduce a Feature Based Adaptive Augmentation (FebAA) approach, which identifies and preserves potentially influential features and corrupts the remaining ones. We implement FebAA as plug and play layer and use it with state-of-the-art Deep Graph Contrastive Learning (GRACE) and Bootstrapped Graph Latents (BGRL). We successfully improved the accuracy of GRACE and BGRL on eight graph representation learning's benchmark datasets.


title: The Short-term Impact of Congestion Taxes on Ridesourcing Demand and Traffic Congestion: Evidence from Chicago

abstract: Ridesourcing is popular in many cities. Despite its theoretical benefits, a large body of studies have claimed that ridesourcing also brings (negative) externalities (e.g., inducing trips and aggravating traffic congestion). Therefore, many cities are planning to enact or have already enacted policies to regulate its use. However, these policies' effectiveness or impact on ridesourcing demand and traffic congestion is uncertain. To this end, this study applies difference-in-differences (i.e., a regression-based causal inference approach) to empirically evaluate the effects of the congestion tax policy on ridesourcing demand and traffic congestion in Chicago. It shows that this congestion tax policy significantly curtails overall ridesourcing demand but marginally alleviates traffic congestion. The results are robust to the choice of time windows and data sets, additional control variables, alternative model specifications, alternative control groups, and alternative modeling approaches (i.e., regression discontinuity in time). Moreover, considerable heterogeneity exists. For example, the policy notably reduces ridesourcing demand with short travel distances, but such an impact is gradually attenuated as the distance increases.


title: Manipulator Differential Kinematics: Part 2: Acceleration and Advanced Applications

abstract: This is the second and final article on the tutorial on manipulator differential kinematics. In Part 1, we described a method of modelling kinematics using the elementary transform sequence (ETS), before formulating forward kinematics and the manipulator Jacobian. We then described some basic applications of the manipulator Jacobian including resolved-rate motion control (RRMC), inverse kinematics (IK), and some manipulator performance measures. In this article, we formulate the second-order differential kinematics, leading to a definition of manipulator Hessian. We then describe the differential kinematics' analytical forms, which are essential to dynamics applications. Subsequently, we provide a general formula for higher-order derivatives. The first application we consider is advanced velocity control. In this section, we extend resolved-rate motion control to perform sub-tasks while still achieving the goal before redefining the algorithm as a quadratic program to enable greater flexibility and additional constraints. We then take another look at numerical inverse kinematics with an emphasis on adding constraints. Finally, we analyse how the manipulator Hessian can help to escape singularities. We have provided Jupyter Notebooks to accompany each section within this tutorial. The Notebooks are written in Python code and use the Robotics Toolbox for Python, and the Swift Simulator to provide examples and implementations of algorithms. While not absolutely essential, for the most engaging and informative experience, we recommend working through the Jupyter Notebooks while reading this article. The Notebooks and setup instructions can be accessed at https://github.com/jhavl/dkt.


title: PatchZero: Defending against Adversarial Patch Attacks by Detecting and Zeroing the Patch

abstract: Adversarial patch attacks mislead neural networks by injecting adversarial pixels within a local region. Patch attacks can be highly effective in a variety of tasks and physically realizable via attachment (e.g. a sticker) to the real-world objects. Despite the diversity in attack patterns, adversarial patches tend to be highly textured and different in appearance from natural images. We exploit this property and present PatchZero, a general defense pipeline against white-box adversarial patches without retraining the downstream classifier or detector. Specifically, our defense detects adversaries at the pixel-level and "zeros out" the patch region by repainting with mean pixel values. We further design a two-stage adversarial training scheme to defend against the stronger adaptive attacks. PatchZero achieves SOTA defense performance on the image classification (ImageNet, RESISC45), object detection (PASCAL VOC), and video classification (UCF101) tasks with little degradation in benign performance. In addition, PatchZero transfers to different patch shapes and attack types.


title: Manipulator Differential Kinematics: Part 1: Kinematics, Velocity, and Applications

abstract: Manipulator kinematics is concerned with the motion of each link within a manipulator without considering mass or force. In this article, which is the first in a two-part tutorial, we provide an introduction to modelling manipulator kinematics using the elementary transform sequence (ETS). Then we formulate the first-order differential kinematics, which leads to the manipulator Jacobian, which is the basis for velocity control and inverse kinematics. We describe essential classical techniques which rely on the manipulator Jacobian before exhibiting some contemporary applications. Part II of this tutorial provides a formulation of second and higher-order differential kinematics, introduces the manipulator Hessian, and illustrates advanced techniques, some of which improve the performance of techniques demonstrated in Part I. We have provided Jupyter Notebooks to accompany each section within this tutorial. The Notebooks are written in Python code and use the Robotics Toolbox for Python, and the Swift Simulator to provide examples and implementations of algorithms. While not absolutely essential, for the most engaging and informative experience, we recommend working through the Jupyter Notebooks while reading this article. The Notebooks and setup instructions can be accessed at https://github.com/jhavl/dkt.


title: Deep Parametric 3D Filters for Joint Video Denoising and Illumination Enhancement in Video Super Resolution

abstract: Despite the quality improvement brought by the recent methods, video super-resolution (SR) is still very challenging, especially for videos that are low-light and noisy. The current best solution is to subsequently employ best models of video SR, denoising, and illumination enhancement, but doing so often lowers the image quality, due to the inconsistency between the models. This paper presents a new parametric representation called the Deep Parametric 3D Filters (DP3DF), which incorporates local spatiotemporal information to enable simultaneous denoising, illumination enhancement, and SR efficiently in a single encoder-and-decoder network. Also, a dynamic residual frame is jointly learned with the DP3DF via a shared backbone to further boost the SR quality. We performed extensive experiments, including a large-scale user study, to show our method's effectiveness. Our method consistently surpasses the best state-of-the-art methods on all the challenging real datasets with top PSNR and user ratings, yet having a very fast run time.


title: GSMFlow: Generation Shifts Mitigating Flow for Generalized Zero-Shot Learning

abstract: Generalized Zero-Shot Learning (GZSL) aims to recognize images from both the seen and unseen classes by transferring semantic knowledge from seen to unseen classes. It is a promising solution to take the advantage of generative models to hallucinate realistic unseen samples based on the knowledge learned from the seen classes. However, due to the generation shifts, the synthesized samples by most existing methods may drift from the real distribution of the unseen data. To address this issue, we propose a novel flow-based generative framework that consists of multiple conditional affine coupling layers for learning unseen data generation. Specifically, we discover and address three potential problems that trigger the generation shifts, i.e., semantic inconsistency, variance collapse, and structure disorder. First, to enhance the reflection of the semantic information in the generated samples, we explicitly embed the semantic information into the transformation in each conditional affine coupling layer. Second, to recover the intrinsic variance of the real unseen features, we introduce a boundary sample mining strategy with entropy maximization to discover more difficult visual variants of semantic prototypes and hereby adjust the decision boundary of the classifiers. Third, a relative positioning strategy is proposed to revise the attribute embeddings, guiding them to fully preserve the inter-class geometric structure and further avoid structure disorder in the semantic space. Extensive experimental results on four GZSL benchmark datasets demonstrate that GSMFlow achieves the state-of-the-art performance on GZSL.


title: Reduced-Order Model of the Russian Service Module via Loewner Framework

abstract: Loewner framework is a technique that uses frequency response data to construct a reduced order model of a given system. In the past, it has been employed in many different synthetic problems and applications like beams. In this work, we exploit the tool on data pertaining to the structural vibrations in the Russian Service module. As per our analysis, the Loewner model performs as good as the original system.


title: Extremal of Log-Sobolev Functionals and Li-Yau Estimate on $\text{RCD}^*(K,N)$ Spaces

abstract: In this work, we study the extremal functions of the log-Sobolev functional on compact metric measure spaces satisfying the $\mathrm{RCD}^*(K,N)$ condition for $K$ in $\mathbb{R}$ and $N$ in $(2,\infty)$. We show the existence, regularity and positivity of non-negative extremal functions. Based on these results, we prove a Li-Yau type estimate for the logarithmic transform of any non-negative extremal functions of the log-Sobolev functional. As applications, we show a Harnack type inequality as well as lower and upper bounds for the non-negative extremal functions.


title: Knowledge Distillation in Quantum Neural Network using Approximate Synthesis

abstract: Recent assertions of a potential advantage of Quantum Neural Network (QNN) for specific Machine Learning (ML) tasks have sparked the curiosity of a sizable number of application researchers. The parameterized quantum circuit (PQC), a major building block of a QNN, consists of several layers of single-qubit rotations and multi-qubit entanglement operations. The optimum number of PQC layers for a particular ML task is generally unknown. A larger network often provides better performance in noiseless simulations. However, it may perform poorly on hardware compared to a shallower network. Because the amount of noise varies amongst quantum devices, the optimal depth of PQC can vary significantly. Additionally, the gates chosen for the PQC may be suitable for one type of hardware but not for another due to compilation overhead. This makes it difficult to generalize a QNN design to wide range of hardware and noise levels. An alternate approach is to build and train multiple QNN models targeted for each hardware which can be expensive. To circumvent these issues, we introduce the concept of knowledge distillation in QNN using approximate synthesis. The proposed approach will create a new QNN network with (i) a reduced number of layers or (ii) a different gate set without having to train it from scratch. Training the new network for a few epochs can compensate for the loss caused by approximation error. Through empirical analysis, we demonstrate ~71.4% reduction in circuit layers, and still achieve ~16.2% better accuracy under noise.


title: Backend Ensemble for Speaker Verification and Spoofing Countermeasure

abstract: This paper describes the NPU system submitted to Spoofing Aware Speaker Verification Challenge 2022. We particularly focus on the \textit{backend ensemble} for speaker verification and spoofing countermeasure from three aspects. Firstly, besides simple concatenation, we propose circulant matrix transformation and stacking for speaker embeddings and countermeasure embeddings. With the stacking operation of newly-defined circulant embeddings, we almost explore all the possible interactions between speaker embeddings and countermeasure embeddings. Secondly, we attempt different convolution neural networks to selectively fuse the embeddings' salient regions into channels with convolution kernels. Finally, we design parallel attention in 1D convolution neural networks to learn the global correlation in channel dimensions as well as to learn the important parts in feature dimensions. Meanwhile, we embed squeeze-and-excitation attention in 2D convolutional neural networks to learn the global dependence among speaker embeddings and countermeasure embeddings. Experimental results demonstrate that all the above methods are effective. After fusion of four well-trained models enhanced by the mentioned methods, the best SASV-EER, SPF-EER and SV-EER we achieve are 0.559\%, 0.354\% and 0.857\% on the evaluation set respectively. Together with the above contributions, our submission system achieves the fifth place in this challenge.


title: Edge-Driven Phase Transitions in 2D Ice

abstract: 2D water, confined by atomically flat layered materials, may transit into various crystalline phases even at room temperature. However, to gain full control over the crystalline state, we should not only confine water in the out of plane direction but also restrict its in plane motion, forming 2D water clusters or ribbons. One way to do this is by using an electric field, in particular the intrinsic electric field of an adjacent polar material. We have found that the crystalline phases of 2D water clusters placed between two hexagonal boron nitride hBN nanoribbons are crucially determined by the nanoribbons edges, the resulting polarity of the nanoribbons, and their interlayer distance. We make use of density functional theory with further assistance of molecular dynamics simulations to establish the comprehensive phase diagrams demonstrating transitions between liquid and solid phases and between the states of different crystalline orders. We also show that the crystalline orders are maintained when water flows between hBN channels under external pressure. Our results open a promising pathway towards the control of water structure and its flow by the use of the microscopic electric field of polar materials.


title: Can large inhomogeneities generate target patterns?

abstract: We study the existence of target patterns in oscillatory media with weak local coupling and in the presence of an impurity, or defect. We model these systems using a viscous eikonal equation posed on the plane, and represent the defect as a perturbation. In contrast to previous results we consider large defects, which we describe using a function with slow algebraic decay, i.e., $g \sim {\mathcal O}(1/|x|^m)$ for $m \in (1,2]$. We prove that these defects are able to generate target patterns and that, just as in the case of strongly localized impurities, their frequency is small beyond all orders of the small parameter describing their strength. Our analysis consists of finding two approximations to target pattern solutions, one which is valid at intermediate scales and a second one which is valid in the far field. This is done using weighted Sobolev spaces, which allow us to recover Fredholm properties of the relevant linear operators, as well as the implicit function theorem, which is then used to prove existence. By matching the intermediate and far field approximations we then determine the frequency of the pattern that is selected by the system.


title: ReMix: A General and Efficient Framework for Multiple Instance Learning based Whole Slide Image Classification

abstract: Whole slide image (WSI) classification often relies on deep weakly supervised multiple instance learning (MIL) methods to handle gigapixel resolution images and slide-level labels. Yet the decent performance of deep learning comes from harnessing massive datasets and diverse samples, urging the need for efficient training pipelines for scaling to large datasets and data augmentation techniques for diversifying samples. However, current MIL-based WSI classification pipelines are memory-expensive and computation-inefficient since they usually assemble tens of thousands of patches as bags for computation. On the other hand, despite their popularity in other tasks, data augmentations are unexplored for WSI MIL frameworks. To address them, we propose ReMix, a general and efficient framework for MIL based WSI classification. It comprises two steps: reduce and mix. First, it reduces the number of instances in WSI bags by substituting instances with instance prototypes, i.e., patch cluster centroids. Then, we propose a ``Mix-the-bag'' augmentation that contains four online, stochastic and flexible latent space augmentations. It brings diverse and reliable class-identity-preserving semantic changes in the latent space while enforcing semantic-perturbation invariance. We evaluate ReMix on two public datasets with two state-of-the-art MIL methods. In our experiments, consistent improvements in precision, accuracy, and recall have been achieved but with orders of magnitude reduced training time and memory consumption, demonstrating ReMix's effectiveness and efficiency. Code is available.