title: Sign and Basis Invariant Networks for Spectral Graph Representation Learning

abstract: We introduce SignNet and BasisNet -- new neural architectures that are invariant to two key symmetries displayed by eigenvectors: (i) sign flips, since if $v$ is an eigenvector then so is $-v$; and (ii) more general basis symmetries, which occur in higher dimensional eigenspaces with infinitely many choices of basis eigenvectors. We prove that under certain conditions our networks are universal, i.e., they can approximate any continuous function of eigenvectors with the desired invariances. When used with Laplacian eigenvectors, our networks are provably more expressive than existing spectral methods on graphs; for instance, they subsume all spectral graph convolutions, certain spectral graph invariants, and previously proposed graph positional encodings as special cases. Experiments show that our networks significantly outperform existing baselines on molecular graph regression, learning expressive graph representations, and learning neural fields on triangle meshes. Our code is available at https://github.com/cptq/SignNet-BasisNet .


title: Model Checking on Interpretations of Classes of Bounded Local Cliquewidth

abstract: We present a fixed-parameter tractable algorithm for first-order model checking on interpretations of graph classes with bounded local cliquewidth. Notably, this includes interpretations of planar graphs, and more generally, of classes of bounded genus. To obtain this result we develop a new tool which works in a very general setting of dependent classes and which we believe can be an important ingredient in achieving similar results in the future.


title: Outside-Obstacle Representations with All Vertices on the Outer Face

abstract: An obstacle representation of a graph $G$ consists of a set of polygonal obstacles and a drawing of $G$ as a visibility graph with respect to the obstacles: vertices are mapped to points and edges to straight-line segments such that each edge avoids all obstacles whereas each non-edge intersects at least one obstacle. Obstacle representations have been investigated quite intensely over the last few years. Here we focus on outside-obstacle representations (OORs) that use only one obstacle in the outer face of the drawing. It is known that every outerplanar graph admits such a representation [Alpert, Koch, Laison; DCG 2010]. We strengthen this result by showing that every (partial) 2-tree has an OOR. We also consider restricted versions of OORs where the vertices of the graph lie on a convex polygon or a regular polygon. We characterize when the complement of a tree and when a complete graph minus a simple cycle admits a convex OOR. We construct regular OORs for all (partial) outerpaths, cactus graphs, and grids.


title: Bounds on Determinantal Complexity of Two Types of Generalized Permanents

abstract: We define two new families of polynomials that generalize permanents and prove upper and lower bounds on their determinantal complexities comparable to the known bounds for permanents. One of these families is obtained by replacing permutations by signed permutations, and the other by replacing permutations by surjective functions with preimages of prescribed sizes.


title: Multi-view Gradient Consistency for SVBRDF Estimation of Complex Scenes under Natural Illumination

abstract: This paper presents a process for estimating the spatially varying surface reflectance of complex scenes observed under natural illumination. In contrast to previous methods, our process is not limited to scenes viewed under controlled lighting conditions but can handle complex indoor and outdoor scenes viewed under arbitrary illumination conditions. An end-to-end process uses a model of the scene's geometry and several images capturing the scene's surfaces from arbitrary viewpoints and under various natural illumination conditions. We develop a differentiable path tracer that leverages least-square conformal mapping for handling multiple disjoint objects appearing in the scene. We follow a two-step optimization process and introduce a multi-view gradient consistency loss which results in up to 30-50% improvement in the image reconstruction loss and can further achieve better disentanglement of the diffuse and specular BRDFs compared to other state-of-the-art. We demonstrate the process in real-world indoor and outdoor scenes from images in the wild and show that we can produce realistic renders consistent with actual images using the estimated reflectance properties. Experiments show that our technique produces realistic results for arbitrary outdoor scenes with complex geometry. The source code is publicly available at: https://gitlab.com/alen.joy/multi-view-gradient-consistency-for-svbrdf-estimation-of-complex-scenes-under-natural-illumination


title: HCIL: Hierarchical Class Incremental Learning for Longline Fishing Visual Monitoring

abstract: The goal of electronic monitoring of longline fishing is to visually monitor the fish catching activities on fishing vessels based on cameras, either for regulatory compliance or catch counting. The previous hierarchical classification method demonstrates efficient fish species identification of catches from longline fishing, where fishes are under severe deformation and self-occlusion during the catching process. Although the hierarchical classification mitigates the laborious efforts of human reviews by providing confidence scores in different hierarchical levels, its performance drops dramatically under the class incremental learning (CIL) scenario. A CIL system should be able to learn about more and more classes over time from a stream of data, i.e., only the training data for a small number of classes have to be present at the beginning and new classes can be added progressively. In this work, we introduce a Hierarchical Class Incremental Learning (HCIL) model, which significantly improves the state-of-the-art hierarchical classification methods under the CIL scenario.


title: Hierarchical symbolic regression for identifying key physical parameters correlated with bulk properties of perovskites

abstract: Symbolic regression identifies key physical parameters describing materials properties by uncovering correlations as nonlinear analytical expressions. However, the pool of expressions grows rapidly with complexity, compromising its efficiency. We tackle this challenge by a hierarchical approach: identified expressions are used as input parameters for obtaining more complex expressions. Crucially, this framework can transfer knowledge among properties, highlighting physical relationships. We demonstrate this strategy by using the Sure-Independence-Screening-and-Sparsifying-Operator (SISSO) approach to identify expressions correlated with the lattice constant and cohesive energy, which are then used to model the bulk modulus of ABO3 perovskites.


title: Energy balance and Alfv\'en Mach numbers in compressible magnetohydrodynamic turbulence with a large-scale magnetic field

abstract: Energy equipartition is a powerful theoretical tool for understanding astrophysical plasmas. It is invoked, for example, to measure magnetic fields in the interstellar medium (ISM), as evidence for small-scale turbulent dynamo action, and, in general, to estimate the energy budget of star-forming molecular clouds. In this study we motivate and explore the role of the volume-averaged root-mean-squared (rms) magnetic coupling term between the turbulent, $\delta\mathbf{B}$ and large-scale, $\mathbf{B}_0$ fields, $\left< (\delta\mathbf{B}\cdot\mathbf{B}_0)^{2} \right>^{1/2}_{\mathcal{V}}$. By considering the second moments of the energy balance equations we show that the rms coupling term is in energy equipartition with the volume-averaged turbulent kinetic energy for turbulence with a sub-Alfv\'enic large-scale field. Under the assumption of exact energy equipartition between these terms, we derive relations for the magnetic and coupling term fluctuations, which provide excellent, parameter-free agreement with time-averaged data from 280 numerical simulations of compressible MHD turbulence. Furthermore, we explore the relation between the turbulent, mean-field and total Alfv\'en Mach numbers, and demonstrate that sub-Alfv\'enic turbulence can only be developed through a strong, large-scale magnetic field, which supports an extremely super-Alfv\'enic turbulent magnetic field. This means that the magnetic field fluctuations are significantly subdominant to the velocity fluctuations in the sub-Alfv\'enic large-scale field regime. Throughout our study, we broadly discuss the implications for observations of magnetic fields and understanding the dynamics in the magnetised ISM.


title: Building a visual semantics aware object hierarchy

abstract: The semantic gap is defined as the difference between the linguistic representations of the same concept, which usually leads to misunderstanding between individuals with different knowledge backgrounds. Since linguistically annotated images are extensively used for training machine learning models, semantic gap problem (SGP) also results in inevitable bias on image annotations and further leads to poor performance on current computer vision tasks. To address this problem, we propose a novel unsupervised method to build visual semantics aware object hierarchy, aiming to get a classification model by learning from pure-visual information and to dissipate the bias of linguistic representations caused by SGP. Our intuition in this paper comes from real-world knowledge representation where concepts are hierarchically organized, and each concept can be described by a set of features rather than a linguistic annotation, namely visual semantic. The evaluation consists of two parts, firstly we apply the constructed hierarchy on the object recognition task and then we compare our visual hierarchy and existing lexical hierarchies to show the validity of our method. The preliminary results reveal the efficiency and potential of our proposed method.


title: Arbitrary Order Energy and Enstrophy Conserving Finite Element Methods for 2D Incompressible Fluid Dynamics and Drift-Reduced Magnetohydrodynamics

abstract: Maintaining conservation laws in the fully discrete setting is critical for accurate long-time behavior of numerical simulations and requires accounting for discrete conservation properties in both space and time. This paper derives arbitrary order finite element exterior calculus spatial discretizations for the two-dimensional (2D) Navier-Stokes and drift-reduced magnetohydrodynamic equations that conserve both energy and enstrophy to machine precision when coupled with generally symplectic time-integration methods. Both continuous and discontinuous-Galerkin (DG) weak formulations can ensure conservation, but only generally symplectic time integration methods, such as the implicit midpoint method, permit exact conservation in time. Moreover, the symplectic implicit midpoint method yields an order of magnitude speedup over explicit schemes. The methods are implemented using the MFEM library and the solutions are verified for an extensive suite of 2D neutral fluid turbulence test problems. Numerical solutions are verified via comparison to a semi-analytic linear eigensolver as well as to the finite difference Global Drift Ballooning (GDB) code. However, it is found that turbulent simulations that conserve both energy and enstrophy tend to have too much power at high wavenumber and that this part of the spectrum should be controlled by reintroducing artificial dissipation. The DG formulation allows upwinding of the advection operator which dissipates enstrophy while still maintaining conservation of energy. Coupling upwinded DG with implicit symplectic integration appears to offer the best compromise of allowing mid-range wavenumbers to reach the appropriate amplitude while still controlling the high-wavenumber part of the spectrum.

categories: physics.flu-dyn cs.NA math.NA physics.comp-ph


title: Quickest Change Detection in Anonymous Heterogeneous Sensor Networks

abstract: The problem of quickest change detection (QCD) in anonymous heterogeneous sensor networks is studied. There are $n$ heterogeneous sensors and a fusion center. The sensors are clustered into $K$ groups, and different groups follow different data-generating distributions. At some unknown time, an event occurs in the network and changes the data-generating distribution of the sensors. The goal is to detect the change as quickly as possible, subject to false alarm constraints. The anonymous setting is studied, where at each time step, the fusion center receives $n$ unordered samples, and the fusion center does not know which sensor each sample comes from, and thus does not know its exact distribution. A simple optimality proof is first derived for the mixture likelihood ratio test, which was constructed and proved to be optimal for the non-sequential anonymous setting in (Chen and Wang, 2019). For the QCD problem, a mixture CuSum algorithm is further constructed, and is further shown to be optimal under Lorden's criterion. For large networks, a computationally efficient test is proposed and a novel theoretical characterization of its false alarm rate is developed. Numerical results are provided to validate the theoretical results.


title: ASSIST: Towards Label Noise-Robust Dialogue State Tracking

abstract: The MultiWOZ 2.0 dataset has greatly boosted the research on dialogue state tracking (DST). However, substantial noise has been discovered in its state annotations. Such noise brings about huge challenges for training DST models robustly. Although several refined versions, including MultiWOZ 2.1-2.4, have been published recently, there are still lots of noisy labels, especially in the training set. Besides, it is costly to rectify all the problematic annotations. In this paper, instead of improving the annotation quality further, we propose a general framework, named ASSIST (lAbel noiSe-robuSt dIalogue State Tracking), to train DST models robustly from noisy labels. ASSIST first generates pseudo labels for each sample in the training set by using an auxiliary model trained on a small clean dataset, then puts the generated pseudo labels and vanilla noisy labels together to train the primary model. We show the validity of ASSIST theoretically. Experimental results also demonstrate that ASSIST improves the joint goal accuracy of DST by up to $28.16\%$ on MultiWOZ 2.0 and $8.41\%$ on MultiWOZ 2.4, compared to using only the vanilla noisy labels.


title: Sofic Lie Algebras

abstract: We introduce and study soficity for Lie algebras, modelled after linear soficity in associative algebras. We introduce equivalent definitions of soficity, one involving metric ultraproducts and the other involving almost representations. We prove that any Lie algebra of subexponential growth is sofic. We also prove that a Lie algebra over a field of characteristic 0 is sofic if and only if its universal enveloping algebra is linearly sofic. Finally, we give explicit families of almost representations for the Witt and Virasoro algebras.


title: Static Analysis Deployment Pitfalls

abstract: Organizational, political, and configuration mistakes in the deployment of a static source code analysis tool within a software development organization can result in most of the value of the tool being lost, even while apparently meeting management goals. A list of pitfalls encountered as a static analysis consultant is presented, with discussion of techniques for avoiding or mitigating them. This is part of a work in progress, tentatively entitled "Handbook of Static Analysis Deployment."


title: Modeling the propagation of tumor fronts with shortest path and diffusion models -- implications for the definition of the clinical target volume

abstract: Objective: The overarching objective is to make the definition of the clinical target volume (CTV) in radiation oncology less subjective and more scientifically based. The specific objective of this study is to investigate similarities and differences between two methods that model tumor spread beyond the visible gross tumor volume (GTV): 1. The shortest path model, which is the standard method of adding a geometric GTV-CTV margin, and 2. The reaction-diffusion model. Approach: These two models to capture the invisible tumor "fire front" are defined and compared in mathematical terms. The models are applied to example cases that represent tumor spread in non-uniform and anisotropic media with anatomical barriers. Main Results: The two seemingly disparate models bring forth traveling waves that can be associated with the front of tumor growth outward from the GTV. The shape of the fronts is similar for both models. Differences are seen in cases where the diffusive flow is reduced due to anatomical barriers, and in complex spatially non-uniform cases. The diffusion model generally leads to smoother fronts. The smoothness can be controlled with a parameter defined by the ratio of the diffusion coefficient and the proliferation rate. Significance: Defining the CTV has been described as the weakest link of the radiotherapy chain. There are many similarities in the mathematical description and the behavior of the common geometric GTV-CTV expansion method, and the definition of the CTV tumor front via the reaction-diffusion model. Its mechanistic basis and the controllable smoothness make the diffusion model an attractive alternative to the standard GTV-CTV margin model.


title: Healthsheet: Development of a Transparency Artifact for Health Datasets

abstract: Machine learning (ML) approaches have demonstrated promising results in a wide range of healthcare applications. Data plays a crucial role in developing ML-based healthcare systems that directly affect people's lives. Many of the ethical issues surrounding the use of ML in healthcare stem from structural inequalities underlying the way we collect, use, and handle data. Developing guidelines to improve documentation practices regarding the creation, use, and maintenance of ML healthcare datasets is therefore of critical importance. In this work, we introduce Healthsheet, a contextualized adaptation of the original datasheet questionnaire ~\cite{gebru2018datasheets} for health-specific applications. Through a series of semi-structured interviews, we adapt the datasheets for healthcare data documentation. As part of the Healthsheet development process and to understand the obstacles researchers face in creating datasheets, we worked with three publicly-available healthcare datasets as our case studies, each with different types of structured data: Electronic health Records (EHR), clinical trial study data, and smartphone-based performance outcome measures. Our findings from the interviewee study and case studies show 1) that datasheets should be contextualized for healthcare, 2) that despite incentives to adopt accountability practices such as datasheets, there is a lack of consistency in the broader use of these practices 3) how the ML for health community views datasheets and particularly \textit{Healthsheets} as diagnostic tool to surface the limitations and strength of datasets and 4) the relative importance of different fields in the datasheet to healthcare concerns.


title: Dynamics of the threshold model on hypergraphs

abstract: The threshold model has been widely adopted as a prototype for studying contagion processes on social networks. In this paper, we consider individual interactions in groups of three or more vertices and study the threshold model on hypergraphs. To understand how high-order interactions affect the breakdown of the system, we develop a theoretical framework based on generating function technology to derive the cascade condition and the giant component of vulnerable vertices, which depend on both hyperedges and hyperdegrees. First, we find a dual role of the hyperedge in propagation: when the average hyperdegree is small, increasing the size of the hyperedges may make the system fragile, while the average hyperdegree is relatively large, the increase of the hyperedges causes the system to be robust. Then, we identify the effects of threshold, hyperdegree, and hyperedge heterogeneities. The heterogeneity of individual thresholds causes the system to be more fragile, while the heterogeneity of individual hyperdegrees or hyperedges increases the robustness of the system. Finally, we show that the higher hyperdegree a vertex has, the larger possibility and faster speed it will get activated. We verify these results by simulating meme spreading on both random hypergraph models and hypergraphs constructed from empirical data.


title: Lattice dynamics in an emergent Zeeman lattice

abstract: Periodic band structures are a hallmark phenomenon of condensed matter physics. While often imposed by external potentials, periodicity can also arise through the interplay of couplings that are not necessarily spatially periodic on their own. Here, we investigate dynamics in a lattice structure that emerges from the simultaneous application of Raman and radio frequency coupling to a dilute-gas Bose-Einstein condensate. We demonstrate a variety of techniques including Kapitza-Dirac scattering, Bloch oscillations, and lattice shaking with spin and momentum resolved measurements. This combined coupling scheme allows for exceptional tunability and control, enabling future investigations into unconventional band structures such as quasi-flat ground bands and those with semimetal-like band gaps.


title: Scotogenic $A_5 \to A_4$ Dirac Neutrinos with Freeze-In Dark Matter

abstract: Radiative Dirac neutrino masses and their mixing are linked to dark matter through the non-Abelian discrete symmetry $A_5$ of the 4-dimensional pentatope, softly broken to $A_4$ of the 3-dimensional tetrahedron. This unifying understanding of neutrino family structure from dark matter is made possible through the interplay of gauge symmetry, renormalizable Lagrangian field theory, and softly broken discrete symmetries. Dark neutral fermions are produced through Higgs decay.


title: Topology optimization of 3D flow fields for flow batteries

abstract: As power generated from renewables becomes more readily available, the need for power-efficient energy storage devices, such as redox flow batteries, becomes critical for successful integration of renewables into the electrical grid. An important component in a redox flow battery is the planar flow field, which is usually composed of two-dimensional channels etched into a backing plate. As reactant-laden electrolyte flows into the flow battery, the channels in the flow field distribute the fluid throughout the reactive porous electrode. We utilize topology optimization to design flow fields with full three-dimensional geometry variation, i.e., 3D flow fields. Specifically, we focus on vanadium redox flow batteries and use the optimization algorithm to generate 3D flow fields evolved from standard interdigitated flow fields by minimizing the electrical and flow pressure power losses. To understand how these designs improve performance, we analyze the polarization of the reactant concentration and exchange current within the electrode to highlight how the designed flow fields mitigate the presence of electrode dead zones. While interdigitated flow fields can be heuristically engineered to yield high performance by tuning channel and land dimensions, such a process can be tedious; this work provides a framework for automating that design process.


title: A New BAT and PageRank algorithm for Propagation Probability in Social Networks

abstract: Social networks have increasingly become important and popular in modern times. Moreover, the influence of social networks plays a vital role in various organizations including government organizations, academic research or corporate organizations. Therefore, how to strategize the optimal propagation strategy in social networks has also become more important. By increasing the precision of evaluating the propagation probability of social network, it can indirectly influence the investment of cost, manpower and time for information propagation to achieve the best return. This study proposes a new algorithm, which includes a scale-free network, Barabasi-Albert model, Binary-Addition-Tree (BAT) algorithm, PageRank algorithm, personalized PageRank algorithm and a new BAT algorithm, to calculate the propagation probability in social networks. The results obtained after implementing the simulation experiment of social network models show the studied model and the proposed algorithm provide an effective method to increase the efficiency of information propagation in social networks. In this way, the maximum propagation efficiency is achieved with the minimum investment.


title: Coronal Mass Ejections and Dimmings: A Comparative Study using MHD Simulations and SDO Observations

abstract: Solar coronal dimmings have been observed extensively in the past two decades. Due to their close association with coronal mass ejections (CMEs), there is a critical need to improve our understanding of the physical processes that cause dimmings as well as their relationship with CMEs. In this study, we investigate coronal dimmings by combining simulation and observational efforts. By utilizing a data-constrained global magnetohydrodynamics model (AWSoM: Alfven-wave Solar Model), we simulate coronal dimmings resulting from different CME energetics and flux rope configurations. We synthesize the emissions of different EUV spectral bands/lines and compare with SDO/AIA and EVE observations. A detailed analysis of the simulation and observation data suggests that the transient dimming / brightening are related to plasma heating processes, while the long-lasting core and remote dimmings are caused by mass loss process induced by the CME. Moreover, the interaction between the erupting flux rope with different orientations and the global solar corona could significantly influence the coronal dimming patterns. Using metrics such as dimming depth and dimming slope, we investigate the relationship between dimmings and CME properties (e.g., CME mass, CME speed) in the simulation. Our result suggests that coronal dimmings encode important information about the associated CMEs, which provides a physical basis for detecting stellar CMEs from distant solar-like stars.


title: Jacobi equations of geodetic brane gravity

abstract: We consider brane gravity as described by the Regge-Teitelboim geometric model, in any codimension. In brane gravity our spacetime is modeled as the time-like world volume spanned by a space-like brane in its evolution, seen as a manifold embedded in an ambient background Minkowski spacetime of higher dimension. Although the equations of motion of the model are well known, apparently their linearization has not been considered before. Using a direct approach, we linearize the equations of motion about a solution, obtaining the Jacobi equations of the Regge- Teitelboim model. They take a formidable aspect. Some of their features are commented upon. By identifying the Jacobi equations, we derive an explicit expression for the Morse index of the model. To be concrete, we apply the Jacobi equations to the study of the stability of a four-dimensional Schwarzschild spacetime embedded in a six-dimensional Minkowski spacetime. We find that it is unstable under small linear deformations.


title: New error bounds for the extended vertical LCP

abstract: In this paper, by making use of this fact that for $a_{j}, b_{j}\in \mathbb{R}$, $j=1,2,\ldots,n$, there are $\lambda_{j}\in [0,1]$ with $\sum_{j=1}^{n}\lambda_{j}=1$ such that \[ \min_{1\leq j\leq n}\{a_{j}\}-\min_{1\leq j\leq n}\{b_{j}\}=\sum_{j=1}^{n}\lambda_{j}(a_{j}-b_{j}), \] some new error bounds of the extended vertical LCP under the row $\mathcal{W}$-property are obtained, which cover the error bounds in [Math. Program., 106 (2006) 513-525] and [Comput. Optim. Appl., 42 (2009) 335-352]. Not only that, these new error bounds skillfully avoid the inconvenience caused by the row rearrangement technique for error bounds to achieve the goal of reducing the computation workload, which was introduced in the latter paper mentioned above. Besides, with respect to the row $\mathcal{W}$-property, two new sufficient and necessary conditions are obtained.


title: Joint Offloading Decision and Resource Allocation for Vehicular Fog-Edge Computing Networks: A Contract-Stackelberg Approach

abstract: With the popularity of mobile devices and development of computationally intensive applications, researchers are focusing on offloading computation to Mobile Edge Computing (MEC) server due to its high computational efficiency and low communication delay. As the computing resources of an MEC server are limited, vehicles in the urban area who have abundant idle resources should be fully utilized. However, offloading computing tasks to vehicles faces many challenging issues. In this paper, we introduce a vehicular fog-edge computing paradigm and formulate it as a multi-stage Stackelberg game to deal with these issues. Specifically, vehicles are not obligated to share resources, let alone disclose their private information (e.g., stay time and the amount of resources). Therefore, in the first stage, we design a contract-based incentive mechanism to motivate vehicles to contribute their idle resources. Next, due to the complicated interactions among vehicles, road-side unit (RSU), MEC server and mobile device users, it is challenging to coordinate the resources of all parties and design a transaction mechanism to make all entities benefit. In the second and third stages, based on Stackelberg game, we develop pricing strategies that maximize the utilities of all parties. The analytical forms of optimal strategies for each stage are given. Simulation results demonstrate the effectiveness of our proposed incentive mechanism, reveal the trends of energy consumption and offloading decisions of users with various parameters, and present the performance comparison between our framework and existing MEC offloading paradigm in vehicular networks.


title: Homeostatic and Adaptive Energetics: Nonequilibrium Fluctuations Beyond Detailed Balance in Voltage-Gated Ion Channels

abstract: Stochastic thermodynamics has largely succeeded in characterizing both equilibrium and far-from-equilibrium phenomena. Yet many opportunities remain for application to mesoscopic complex systems -- especially biological ones -- whose effective dynamics often violate detailed balance and whose microscopic degrees of freedom are often unknown or intractable. After reviewing excess and housekeeping energetics -- the adaptive and homeostatic components of a system's dissipation -- we extend stochastic thermodynamics with a trajectory class fluctuation theorem for nonequilibrium steady-state, nondetailed-balanced complex systems. We then take up the neurobiological examples of voltage-gated sodium and potassium ion channels to apply and illustrate the theory, elucidating their nonequilibrium behavior under a biophysically plausible action potential drive. These results uncover challenges for future experiments and highlight the progress possible understanding the thermodynamics of complex systems -- without exhaustive knowledge of every underlying degree of freedom.

categories: cond-mat.stat-mech nlin.AO physics.bio-ph q-bio.NC


title: A Rich Satellite Population of the NGC 4437 Group and Implications of a Magnitude Gap for Galaxy Group Assembly History

abstract: Both observations and cosmological simulations have recently shown that there is a large scatter in the number of satellites of Milky Way (MW)-like galaxies. In this study, we investigate the relation between the satellite number and galaxy group assembly history, using the $r-$band magnitude gap ($\Delta m_{12}$) between the first and the second brightest galaxy as an indicator. From 20 deg$^2$ of Hyper Suprime-Cam Subaru Strategic Program Wide layer, we identify 17 dwarf satellite candidates around NGC 4437, a spiral galaxy with about one-fourth of the MW stellar mass. We estimate their distances using the surface brightness fluctuation (SBF) method. Then we confirm five candidates as members of the NGC 4437 group, resulting in a total of seven group members. Combining the NGC 4437 group (with $\Delta m_{12} = 2.5$ mag) with other groups in the literature, we find a stratification of the satellite number by $\Delta m_{12}$ for a given host stellar mass. The satellite number for given host stellar mass decreases as $\Delta m_{12}$ increases. The same trend is found in simulated galaxy groups in IllustrisTNG50 simulations. We also find that the host galaxies in groups with a smaller $\Delta m_{12}$ (like NGC 4437) have assembled their halo mass more recently than those in larger gap groups, and that their stellar-to-halo mass ratios (SHMRs) increase as $\Delta m_{12}$ increases. These results show that the large scatter in the satellite number is consistent with a large range of $\Delta m_{12}$, indicating diverse group assembly histories.


title: Iterative Genetic Improvement: Scaling Stochastic Program Synthesis

abstract: Program synthesis aims to {\it automatically} find programs from an underlying programming language that satisfy a given specification. While this has the potential to revolutionize computing, how to search over the vast space of programs efficiently is an unsolved challenge in program synthesis. In cases where large programs are required for a solution, it is generally believed that {\it stochastic} search has advantages over other classes of search techniques. Unfortunately, existing stochastic program synthesizers do not meet this expectation very well, suffering from the scalability issue. Here we propose a new framework for stochastic program synthesis, called iterative genetic improvement to overcome this problem, a technique inspired by the practice of the software development process. The key idea of iterative genetic improvement is to apply genetic improvement to improve a current reference program, and then iteratively replace the reference program by the best program found. Compared to traditional stochastic synthesis approaches, iterative genetic improvement can build up the complexity of programs incrementally in a more robust way. We evaluate the approach on two program synthesis domains: list manipulation and string transformation. Our empirical results indicate that this method has considerable advantages over several representative stochastic program synthesizer techniques, both in terms of scalability and of solution quality.


title: Towards Revenue Maximization with Popular and Profitable Products

abstract: Economic-wise, a common goal for companies conducting marketing is to maximize the return revenue/profit by utilizing the various effective marketing strategies. Consumer behavior is crucially important in economy and targeted marketing, in which behavioral economics can provide valuable insights to identify the biases and profit from customers. Finding credible and reliable information on products' profitability is, however, quite difficult since most products tends to peak at certain times w.r.t. seasonal sales cycle in a year. On-Shelf Availability (OSA) plays a key factor for performance evaluation. Besides, staying ahead of hot product trends means we can increase marketing efforts without selling out the inventory. To fulfill this gap, in this paper, we first propose a general profit-oriented framework to address the problem of revenue maximization based on economic behavior, and compute the 0n-shelf Popular and most Profitable Products (OPPPs) for the targeted marketing. To tackle the revenue maximization problem, we model the k-satisfiable product concept and propose an algorithmic framework for searching OPPP and its variants. Extensive experiments are conducted on several real-world datasets to evaluate the effectiveness and efficiency of the proposed algorithm.


title: Low SNR Multiframe Registration for Cubesats

abstract: We present a registration algorithm which jointly estimates motion and the ground truth image from a set of noisy frames under rigid, constant translation. The algorithm is non-iterative and needs no hyperparameter tuning. It requires a fixed number of FFT, multiplication, and downsampling operations for a given input size, enabling fast implementation on embedded platforms like cubesats where on-board image fusion can greatly save on limited downlink bandwidth. The algorithm is optimal in the maximum likelihood sense for additive white Gaussian noise and non-stationary Gaussian approximations of Poisson noise. Accurate registration is achieved for very low SNR, even when visible features are below the noise floor.


title: Generalized Label Shift Correction via Minimum Uncertainty Principle: Theory and Algorithm

abstract: As a fundamental problem in machine learning, dataset shift induces a paradigm to learn and transfer knowledge under changing environment. Previous methods assume the changes are induced by covariate, which is less practical for complex real-world data. We consider the Generalized Label Shift (GLS), which provides an interpretable insight into the learning and transfer of desirable knowledge. Current GLS methods: 1) are not well-connected with the statistical learning theory; 2) usually assume the shifting conditional distributions will be matched with an implicit transformation, but its explicit modeling is unexplored. In this paper, we propose a conditional adaptation framework to deal with these challenges. From the perspective of learning theory, we prove that the generalization error of conditional adaptation is lower than previous covariate adaptation. Following the theoretical results, we propose the minimum uncertainty principle to learn conditional invariant transformation via discrepancy optimization. Specifically, we propose the \textit{conditional metric operator} on Hilbert space to characterize the distinctness of conditional distributions. For finite observations, we prove that the empirical estimation is always well-defined and will converge to underlying truth as sample size increases. The results of extensive experiments demonstrate that the proposed model achieves competitive performance under different GLS scenarios.


title: A combined multiscale finite element method based on the LOD technique for the multiscale elliptic problems with singularities

abstract: In this paper, we construct a combined multiscale finite element method (MsFEM) using the Local Orthogonal Decomposition (LOD) technique to solve the multiscale problems which may have singularities in some special portions of the computational domain. For example, in the simulation of steady flow transporting through highly heterogeneous porous media driven by extraction wells, the singularities lie in the near-well regions. The basic idea of the combined method is to utilize the traditional finite element method (FEM) directly on a fine mesh of the problematic part of the domain and using the LOD-based MsFEM on a coarse mesh of the other part. The key point is how to define local correctors for the basis functions of the elements near the coarse and fine mesh interface, which require meticulous treatment. The proposed method takes advantages of the traditional FEM and the LOD-based MsFEM, which uses much less DOFs than the standard FEM and may be more accurate than the LOD-based MsFEM for problems with singularities. The error analysis is carried out for highly varying coefficients, without any assumptions on scale separation or periodicity. {Numerical examples with periodic and random highly oscillating coefficients}, as well as the multiscale problems on the L-shaped domain, and multiscale problems with high-contrast channels or well-singularities are presented to demonstrate the efficiency and accuracy of the proposed method.


title: Effects of Polydispersity on the Plastic Behaviors of Dense 2D Granular Systems Under Shear

abstract: We study particle-scale motion in sheared highly polydisperse amorphous materials, in which the largest particles are as much as ten times the size of the smallest. We find strikingly different behavior from the more commonly studied amorphous systems with low polydispersity. In particular, analysis of the nonaffine motion of particles reveals qualitative differences between large and small particles: the smaller particles have dramatically more nonaffine motion, which is induced by the presence of the large particles. We characterize the crossover in nonaffine motion from the low- to high-polydispersity regime, and demonstrate a quantitative way to distinguish between "large" and "small" particles in systems with broad distributions of particle sizes.


title: Distributed Multi-Agent Reinforcement Learning Based on Graph-Induced Local Value Functions

abstract: Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity emerge due to the curse of dimensionality. In this paper, we propose a general computationally efficient distributed framework for cooperative multi-agent reinforcement learning (MARL) by utilizing the structures of graphs involved in this problem. We introduce three coupling graphs describing three types of inter-agent couplings in MARL, namely, the state graph, the observation graph and the reward graph. By further considering a communication graph, we propose two distributed RL approaches based on local value-functions derived from the coupling graphs. The first approach is able to reduce sample complexity significantly under specific conditions on the aforementioned four graphs. The second approach provides an approximate solution and can be efficient even for problems with dense coupling graphs. Here there is a trade-off between minimizing the approximation error and reducing the computational complexity. Simulations show that our RL algorithms have a significantly improved scalability to large-scale MASs compared with centralized and consensus-based distributed RL algorithms.


title: AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation

abstract: Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage large language models for dialogue augmentation in the task of emotional support conversation (ESC). By treating dialogue augmentation as a dialogue completion task, we prompt a fine-tuned language model to complete full dialogues from available dialogue posts of various topics, which are then postprocessed based on heuristics. Applying this approach, we construct AugESC, an augmented dataset for the ESC task, which largely extends the scale and topic coverage of the crowdsourced ESConv corpus. Through comprehensive human evaluation, we demonstrate that our approach is superior to strong baselines of dialogue augmentation and that AugESC has comparable dialogue quality to the crowdsourced corpus. We also conduct human interactive evaluation and prove that post-training on AugESC improves downstream dialogue models' generalization ability to open-domain topics. These results suggest the utility of AugESC and highlight the potential of large language models in improving data-scarce dialogue generation tasks.


title: Bayesian Ridge Regression Based Model to Predict Fault Location in HVdc Network

abstract: This paper discusses a method for accurately estimating the fault location in multi-terminal High Voltage direct current (HVdc) transmission network using single ended current and voltage measurements. The post-fault voltage and current signatures are a function of multiple factors and thus accurately locating faults on a multi-terminal network is challenging. We discuss a novel data-driven Bayes Regression based method for accurately predicting fault locations. The sensitivity of the proposed algorithm to measurement noise, fault location, resistance and current limiting inductance are performed on a radial three-terminal MTdc network. The test system is designed in Power System Computer Aided Design (PSCAD)/Electromagnetic Transients including dc (EMTdc).


title: Five-point Toponogov theorem

abstract: We give an if-and-only-if condition on a five-point metric spaces that admit embeddings into nonnegatively curved Riemannian manifolds.


title: Optical flow-based branch segmentation for complex orchard environments

abstract: Machine vision is a critical subsystem for enabling robots to be able to perform a variety of tasks in orchard environments. However, orchards are highly visually complex environments, and computer vision algorithms operating in them must be able to contend with variable lighting conditions and background noise. Past work on enabling deep learning algorithms to operate in these environments has typically required large amounts of hand-labeled data to train a deep neural network or physically controlling the conditions under which the environment is perceived. In this paper, we train a neural network system in simulation only using simulated RGB data and optical flow. This resulting neural network is able to perform foreground segmentation of branches in a busy orchard environment without additional real-world training or using any special setup or equipment beyond a standard camera. Our results show that our system is highly accurate and, when compared to a network using manually labeled RGBD data, achieves significantly more consistent and robust performance across environments that differ from the training set.


title: Three-dimensional Propagation of the Global EUV Wave associated with a solar eruption on 2021 October 28

abstract: We present a case study for the global extreme ultraviolet (EUV) wave and its chromospheric counterpart `Moreton-Ramsey wave' associated with the second X-class flare in Solar Cycle 25 and a halo coronal mass ejection (CME). The EUV wave was observed in the H$\alpha$ and EUV passbands with different characteristic temperatures. In the 171 {\AA} and 193/195 {\AA} images, the wave propagates circularly with an initial velocity of 600-720 km s$^{-1}$ and a deceleration of 110-320 m s$^{-2}$. The local coronal plasma is heated from log(T/K)=5.9 to log(T/K)=6.2 during the passage of the wavefront. The H$\alpha$ and 304 {\AA} images also reveal signatures of wave propagation with a velocity of 310-540 km s$^{-1}$. With multi-wavelength and dual-perspective observations, we found that the wavefront likely propagates forwardly inclined to the solar surface with a tilt angle of ~53.2$^{\circ}$. Our results suggest that this EUV wave is a fast-mode magnetohydrodynamic wave or shock driven by the expansion of the associated CME, whose wavefront is likely a dome-shaped structure that could impact the upper chromosphere, transition region and corona.


title: Arbitrary high-order structure-preserving methods for the quantum Zakharov system

abstract: In this paper, we present a new methodology to develop arbitrary high-order structure-preserving methods for solving the quantum Zakharov system. The key ingredients of our method are: (i) the original Hamiltonian energy is reformulated into a quadratic form by introducing a new quadratic auxiliary variable; (ii) based on the energy variational principle, the original system is then rewritten into a new equivalent system which inherits the mass conservation law and a quadratic energy; (iii) the resulting system is discretized by symplectic Runge-Kutta method in time combining with the Fourier pseudo-spectral method in space. The proposed method achieves arbitrary high-order accurate in time and can preserve the discrete mass and original Hamiltonian energy exactly. Moreover, an efficient iterative solver is presented to solve the resulting discrete nonlinear equations. Finally, ample numerical examples are presented to demonstrate the theoretical claims and illustrate the efficiency of our methods.


title: A Primer on the Dynamical Systems Approach to Transport in Porous Media

abstract: Historically, the dominant conceptual paradigm of porous media flow, solute mixing and transport was based on steady two-dimensional flows in heterogeneous porous media. Although it is now well recognised that novel transport phenomena can arise in unsteady and/or three-dimensional flows at both the pore- or Darcy-scales, appropriate methods for analysis and understanding of these more complex flows have not been widely employed. In this primer we advocate for methods borrowed from dynamical systems (chaos) theory, which aim to uncover the \emph{Lagrangian kinematics} of these flows: namely how fluid particle trajectories (which form a dynamical system) are organized and interact and the associated impacts on solute transport and mixing. This dynamical systems approach to transport is inherently Lagrangian, and the Lagrangian kinematics form Lagrangian coherent structures (LCSs), special sets of trajectories that divide the Lagrangian frame into chaotic mixing regions, poorly mixing hold-up regions (and in some cases non-mixing ``islands'') and the transport barriers that organise these regions. Hence the dynamical systems approach provides insights into flows that may exhibit chaotic, regular (non-chaotic) or mixed Lagrangian kinematics, and also into how LCSs organize solute transport and mixing. Novel experimental methods are only recently permitting visualization of LCSs are in porous media flows. In this primer we review the dynamical systems approach to porous media flow and transport and connect the associated tools and techniques with the latest research findings from pore to Darcy scales. This primer provides an introduction to the methods and tools of dynamical systems theory. Once familiar with these approaches, porous media researchers will be better positioned to know when to expect complex Lagrangian kinematics, how to uncover and understand LCSs and their impacts ...


title: Missing Value Knockoffs

abstract: One limitation of the most statistical/machine learning-based variable selection approaches is their inability to control the false selections. A recently introduced framework, model-x knockoffs, provides that to a wide range of models but lacks support for datasets with missing values. In this work, we discuss ways of preserving the theoretical guarantees of the model-x framework in the missing data setting. First, we prove that posterior sampled imputation allows reusing existing knockoff samplers in the presence of missing values. Second, we show that sampling knockoffs only for the observed variables and applying univariate imputation also preserves the false selection guarantees. Third, for the special case of latent variable models, we demonstrate how jointly imputing and sampling knockoffs can reduce the computational complexity. We have verified the theoretical findings with two different exploratory variable distributions and investigated how the missing data pattern, amount of correlation, the number of observations, and missing values affected the statistical power.


title: Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance

abstract: We propose a learning-based depth from focus/defocus (DFF), which takes a focal stack as input for estimating scene depth. Defocus blur is a useful cue for depth estimation. However, the size of the blur depends on not only scene depth but also camera settings such as focus distance, focal length, and f-number. Current learning-based methods without any defocus models cannot estimate a correct depth map if camera settings are different at training and test times. Our method takes a plane sweep volume as input for the constraint between scene depth, defocus images, and camera settings, and this intermediate representation enables depth estimation with different camera settings at training and test times. This camera-setting invariance can enhance the applicability of learning-based DFF methods. The experimental results also indicate that our method is robust against a synthetic-to-real domain gap, and exhibits state-of-the-art performance.


title: Automated Identification of Toxic Code Reviews Using ToxiCR

abstract: Toxic conversations during software development interactions may have serious repercussions on a Free and Open Source Software (FOSS) development project. For example, victims of toxic conversations may become afraid to express themselves, therefore get demotivated, and may eventually leave the project. Automated filtering of toxic conversations may help a FOSS community to maintain healthy interactions among its members. However, off-the-shelf toxicity detectors perform poorly on Software Engineering (SE) datasets, such as one curated from code review comments. To encounter this challenge, we present ToxiCR, a supervised learning-based toxicity identification tool for code review interactions. ToxiCR includes a choice to select one of the ten supervised learning algorithms, an option to select text vectorization techniques, eight preprocessing steps, and a large-scale labeled dataset of 19,571 code review comments. Two out of those eight preprocessing steps are SE domain specific. With our rigorous evaluation of the models with various combinations of preprocessing steps and vectorization techniques, we have identified the best combination for our dataset that boosts 95.8% accuracy and 88.9% F1 score. ToxiCR significantly outperforms existing toxicity detectors on our dataset. We have released our dataset, pre-trained models, evaluation results, and source code publicly available at: https://github.com/WSU-SEAL/ToxiCR


title: Initialization of Latent Space Coordinates via Random Linear Projections for Learning Robotic Sensory-Motor Sequences

abstract: Robot kinematics data, despite being a high dimensional process, is highly correlated, especially when considering motions grouped in certain primitives. These almost linear correlations within primitives allow us to interpret the motions as points drawn close to a union of low-dimensional linear subspaces in the space of all motions. Motivated by results of embedding theory, in particular, generalizations of Whitney embedding theorem, we show that random linear projection of motor sequences into low dimensional space loses very little information about structure of kinematics data. Projected points are very good initial guess for values of latent variables in generative model for robot sensory-motor behaviour primitives. We conducted series of experiments where we trained a recurrent neural network to generate sensory-motor sequences for robotic manipulator with 9 degrees of freedom. Experimental results demonstrate substantial improvement in generalisation abilities for unobserved samples in the case of initialization of latent variables with random linear projection of motor data over initialization with zero or random values. Moreover, latent space is well-structured wherein samples belonging to different primitives are well separated from the onset of training process.


title: Random Access with Massive MIMO-OTFS in LEO Satellite Communications

abstract: This paper considers the joint channel estimation and device activity detection in the grant-free random access systems, where a large number of Internet-of-Things devices intend to communicate with a low-earth orbit satellite in a sporadic way. In addition, the massive multiple-input multiple-output (MIMO) with orthogonal time-frequency space (OTFS) modulation is adopted to combat the dynamics of the terrestrial-satellite link. We first analyze the input-output relationship of the single-input single-output OTFS when the large delay and Doppler shift both exist, and then extend it to the grant-free random access with massive MIMO-OTFS. Next, by exploring the sparsity of channel in the delay-Doppler-angle domain, a two-dimensional pattern coupled hierarchical prior with the sparse Bayesian learning and covariance-free method (TDSBL-CF) is developed for the channel estimation. Then, the active devices are detected by computing the energy of the estimated channel. Finally, the generalized approximate message passing algorithm combined with the sparse Bayesian learning and two-dimensional convolution (ConvSBL-GAMP) is proposed to decrease the computations of the TDSBL-CF algorithm. Simulation results demonstrate that the proposed algorithms outperform conventional methods.


title: Theoretical Error Analysis of Entropy Approximation for Gaussian Mixture

abstract: Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be analytically calculated. Notably, Gal and Ghahramani [2016] proposed the approximate entropy that is the sum of the entropies of unimodal Gaussian distributions. This approximation is easy to analytically calculate regardless of dimension, but there lack theoretical guarantees. In this paper, we theoretically analyze the approximation error between the true entropy and the approximate one to reveal when this approximation works effectively. This error is controlled by how far apart each Gaussian component of the Gaussian mixture. To measure such separation, we introduce the ratios of the distances between the means to the sum of the variances of each Gaussian component of the Gaussian mixture, and we reveal that the error converges to zero as the ratios tend to infinity. This convergence situation is more likely to occur in higher dimensional spaces. Therefore, our results provide a guarantee that this approximation works well in higher dimension problems, particularly in scenarios such as neural networks that involve a large number of weights.


title: Graph Attention Retrospective

abstract: Graph-based learning is a rapidly growing sub-field of machine learning with applications in social networks, citation networks, and bioinformatics. One of the most popular models is graph attention networks. They were introduced to allow a node to aggregate information from features of neighbor nodes in a non-uniform way, in contrast to simple graph convolution which does not distinguish the neighbors of a node. In this paper, we theoretically study the behaviour of graph attention networks. We prove multiple results on the performance of the graph attention mechanism for the problem of node classification for a contextual stochastic block model. Here, the node features are obtained from a mixture of Gaussians and the edges from a stochastic block model. We show that in an "easy" regime, where the distance between the means of the Gaussians is large enough, graph attention is able to distinguish inter-class from intra-class edges. Thus it maintains the weights of important edges and significantly reduces the weights of unimportant edges. Consequently, we show that this implies perfect node classification. In the "hard" regime, we show that every attention mechanism fails to distinguish intra-class from inter-class edges. In addition, we show that graph attention convolution cannot (almost) perfectly classify the nodes even if intra-class edges could be separated from inter-class edges. Beyond perfect node classification, we provide a positive result on graph attention's robustness against structural noise in the graph. In particular, our robustness result implies that graph attention can be strictly better than both the simple graph convolution and the best linear classifier of node features. We evaluate our theoretical results on synthetic and real-world data.


title: The expected degree of noninvertibility of compositions of functions and a related combinatorial identity

abstract: Recently, Defant and Propp [2020] defined the degree of noninvertibility of a function $f\colon X\to Y$ between two finite nonempty sets by $\text{deg}(f)=\frac{1}{|X|}\sum_{x\in X}|f^{-1}(f(x))|$. We obtain an exact formula for the expected degree of noninvertibility of the composition of $t$ functions for every $t\in \mathbb{N}$. An equivalent formulation for the definition of the degree of noninvertibility is then the starting point for a generalization yielding a seemingly new combinatorial identity involving the Stirling transform of the signed Stirling numbers of the first kind.


title: Learning-based Collision-free Planning on Arbitrary Optimization Criteria in the Latent Space through cGANs

abstract: We propose a new method for collision-free planning using Conditional Generative Adversarial Networks (cGANs) to transform between the robot's joint space and a latent space that captures only collision-free areas of the joint space, conditioned by an obstacle map. Generating multiple plausible trajectories is convenient in applications such as the manipulation of a robot arm by enabling the selection of trajectories that avoids collision with the robot or surrounding environment. In the proposed method, various trajectories that avoid obstacles can be generated by connecting the start and goal state with arbitrary line segments in this generated latent space. Our method provides this collision-free latent space, after which any planner, using any optimization conditions, can be used to generate the most suitable paths on the fly. We successfully verified this method with a simulated and actual UR5e 6-DoF robotic arm. We confirmed that different trajectories could be generated depending on optimization conditions.


title: Reheating and Dark Matter Freeze-in in the Higgs-$R^2$ Inflation Model

abstract: We study the post-inflationary dynamics for reheating and freeze-in dark matter in the Higgs-$R^2$ inflation model. Taking the perturbative approach for reheating, we determine the evolution of the temperature for radiation bath produced during reheating and determine the maximum and reheating temperatures of the Universe. Adopting a singlet scalar dark matter with a conformal non-minimal coupling and a vanishing Higgs-portal coupling, we discuss the freeze-in production of dark matter both from the non-thermal scattering during reheating and the thermal scattering after reheating. We find that thermal scattering is dominant for dark matter production in our model due to the high reheating temperature. The reheating temperature in our model is determined dominantly by the Higgs condensate to be up to about $10^{14}\,{\rm GeV}$ and dark matter with masses up to about $10^9\,{\rm GeV}$ can be produced with a correct relic density.


title: Watch Me Calibrate My Force-Sensing Shoes!

abstract: This paper presents a novel method for smaller-sized humanoid robots to self-calibrate their foot force sensors. The method consists of two steps: 1. The robot is commanded to move along planned whole-body trajectories in different double support configurations. 2. The sensor parameters are determined by minimizing the error between the measured and modeled center of pressure (CoP) and ground reaction force (GRF) during the robot's movement using optimization. This is the first proposed autonomous calibration method for foot force-sensing devices in smaller humanoid robots. Furthermore, we introduce a high-accuracy manual calibration method to establish CoP ground truth, which is used to validate the measured CoP using self-calibration. The results show that the self-calibration can accurately estimate CoP and GRF without any manual intervention. Our method is demonstrated using a NAO humanoid platform and our previously presented force-sensing shoes.


title: An End-to-End Transformer Model for Crowd Localization

abstract: Crowd localization, predicting head positions, is a more practical and high-level task than simply counting. Existing methods employ pseudo-bounding boxes or pre-designed localization maps, relying on complex post-processing to obtain the head positions. In this paper, we propose an elegant, end-to-end Crowd Localization Transformer named CLTR that solves the task in the regression-based paradigm. The proposed method views the crowd localization as a direct set prediction problem, taking extracted features and trainable embeddings as input of the transformer-decoder. To reduce the ambiguous points and generate more reasonable matching results, we introduce a KMO-based Hungarian matcher, which adopts the nearby context as the auxiliary matching cost. Extensive experiments conducted on five datasets in various data settings show the effectiveness of our method. In particular, the proposed method achieves the best localization performance on the NWPU-Crowd, UCF-QNRF, and ShanghaiTech Part A datasets.


title: Revisiting Over-Smoothness in Text to Speech

abstract: Non-autoregressive text to speech (NAR-TTS) models have attracted much attention from both academia and industry due to their fast generation speed. One limitation of NAR-TTS models is that they ignore the correlation in time and frequency domains while generating speech mel-spectrograms, and thus cause blurry and over-smoothed results. In this work, we revisit this over-smoothing problem from a novel perspective: the degree of over-smoothness is determined by the gap between the complexity of data distributions and the capability of modeling methods. Both simplifying data distributions and improving modeling methods can alleviate the problem. Accordingly, we first study methods reducing the complexity of data distributions. Then we conduct a comprehensive study on NAR-TTS models that use some advanced modeling methods. Based on these studies, we find that 1) methods that provide additional condition inputs reduce the complexity of data distributions to model, thus alleviating the over-smoothing problem and achieving better voice quality. 2) Among advanced modeling methods, Laplacian mixture loss performs well at modeling multimodal distributions and enjoys its simplicity, while GAN and Glow achieve the best voice quality while suffering from increased training or model complexity. 3) The two categories of methods can be combined to further alleviate the over-smoothness and improve the voice quality. 4) Our experiments on the multi-speaker dataset lead to similar conclusions as above and providing more variance information can reduce the difficulty of modeling the target data distribution and alleviate the requirements for model capacity.


title: A Robust Document Image Watermarking Scheme using Deep Neural Network

abstract: Watermarking is an important copyright protection technology which generally embeds the identity information into the carrier imperceptibly. Then the identity can be extracted to prove the copyright from the watermarked carrier even after suffering various attacks. Most of the existing watermarking technologies take the nature images as carriers. Different from the natural images, document images are not so rich in color and texture, and thus have less redundant information to carry watermarks. This paper proposes an end-to-end document image watermarking scheme using the deep neural network. Specifically, an encoder and a decoder are designed to embed and extract the watermark. A noise layer is added to simulate the various attacks that could be encountered in reality, such as the Cropout, Dropout, Gaussian blur, Gaussian noise, Resize, and JPEG Compression. A text-sensitive loss function is designed to limit the embedding modification on characters. An embedding strength adjustment strategy is proposed to improve the quality of watermarked image with little loss of extraction accuracy. Experimental results show that the proposed document image watermarking technology outperforms three state-of-the-arts in terms of the robustness and image quality.


title: Long-time dynamics of a nonlocal epidemic model with free boundaries: spreading-vanishing dichotomy

abstract: In this paper, we examine the long-time dynamics of an epidemic model whose diffusion and reaction terms involve nonlocal effects described by suitable convolution operators.The spreading front of the disease is represented by the free boundaries in the model. We show that the model is well-posed, its long-time dynamical behaviour is characterised by a spreading-vanishing dichotomy, and we also obtain sharp criteria to determine the dichotomy. Some of the nonlocal effects in the model pose extra difficulties in the mathematical treatment, which are dealt with by introducing new approaches. The model can capture accelerated spreading, and its spreading rate will be discussed in a subsequent work.


title: 2D magnetoelectric multiferroics in MnSTe/In2Se3 heterobilayer with ferroelectrically controllable skyrmions

abstract: The magnetoelectric effect and skyrmions are two fundamental phenomena in the field of condensed-matter physics. Here, using first-principles calculations and Monte-Carlo simulations, we propose that strong magnetoelectric coupling can be demonstrated in a multiferroic heterobilayer consisting of two-dimensional (2D) MnSTe and {\alpha}-In2Se3. As the electric polarization in ferroelectric {\alpha}-In2Se3 is switched, the creation and annihilation of topological magnetic phase can be achieved in this multiferroic heterobilayer, giving rise to the intriguing ferroelectrically controllable skyrmions. This feature is further revealed to be closely related to the physical quantity of D2/|KJ|, which is generally applicable for describing the required conditions of such physics. Moreover, the evaluations of their topological magnetic phases with temperature are systematically discussed. These insights not only greatly enrich the research on 2D magnetoelectric multiferroics, but also pave a promising avenue to realize new skyrmionic device concepts.


title: Phenomenology of Trimaximal mixing with one texture equality

abstract: We study neutrino mass matrices with one texture equality and the neutrino mixing matrix having either its first (TM$_1$) or second (TM$_2$) column identical to that of the tribimaximal mixing matrix. We found that out of total fifteen possible neutrino mass matrices with one texture equality, only seven textures are compatible with $TM_1$ mixing and six textures are compatible with $TM_2$ mixing in the light of the current neutrino oscillation data. These textures have interesting implications for the presently unknown parameters such as the neutrino mass scale, effective Majorana neutrino mass, the atmospheric mixing and the Dirac- and Majorana-type CP violating phases. We, also, present the $S_{3}$ group motivation for some of these textures.


title: Uncertainty-Aware Deep Multi-View Photometric Stereo

abstract: This paper presents a simple and effective solution to the longstanding classical multi-view photometric stereo (MVPS) problem. It is well-known that photometric stereo (PS) is excellent at recovering high-frequency surface details, whereas multi-view stereo (MVS) can help remove the low-frequency distortion due to PS and retain the global geometry of the shape. This paper proposes an approach that can effectively utilize such complementary strengths of PS and MVS. Our key idea is to combine them suitably while considering the per-pixel uncertainty of their estimates. To this end, we estimate per-pixel surface normals and depth using an uncertainty-aware deep-PS network and deep-MVS network, respectively. Uncertainty modeling helps select reliable surface normal and depth estimates at each pixel which then act as a true representative of the dense surface geometry. At each pixel, our approach either selects or discards deep-PS and deep-MVS network prediction depending on the prediction uncertainty measure. For dense, detailed, and precise inference of the object's surface profile, we propose to learn the implicit neural shape representation via a multilayer perceptron (MLP). Our approach encourages the MLP to converge to a natural zero-level set surface using the confident prediction from deep-PS and deep-MVS networks, providing superior dense surface reconstruction. Extensive experiments on the DiLiGenT-MV benchmark dataset show that our method provides high-quality shape recovery with a much lower memory footprint while outperforming almost all of the existing approaches.


title: Adversarial Contrastive Self-Supervised Learning

abstract: Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention. Self-supervised learning followed by the supervised fine-tuning on a few labeled examples can significantly improve label efficiency and outperform standard supervised training using fully annotated data. In this work, we present a novel self-supervised deep learning paradigm based on online hard negative pair mining. Specifically, we design a student-teacher network to generate multi-view of the data for self-supervised learning and integrate hard negative pair mining into the training. Then we derive a new triplet-like loss considering both positive sample pairs and mined hard negative sample pairs. Extensive experiments demonstrate the effectiveness of the proposed method and its components on ILSVRC-2012.


title: Global Instance Tracking: Locating Target More Like Humans

abstract: Target tracking, the essential ability of the human visual system, has been simulated by computer vision tasks. However, existing trackers perform well in austere experimental environments but fail in challenges like occlusion and fast motion. The massive gap indicates that researches only measure tracking performance rather than intelligence. How to scientifically judge the intelligence level of trackers? Distinct from decision-making problems, lacking three requirements (a challenging task, a fair environment, and a scientific evaluation procedure) makes it strenuous to answer the question. In this article, we first propose the global instance tracking (GIT) task, which is supposed to search an arbitrary user-specified instance in a video without any assumptions about camera or motion consistency, to model the human visual tracking ability. Whereafter, we construct a high-quality and large-scale benchmark VideoCube to create a challenging environment. Finally, we design a scientific evaluation procedure using human capabilities as the baseline to judge tracking intelligence. Additionally, we provide an online platform with toolkit and an updated leaderboard. Although the experimental results indicate a definite gap between trackers and humans, we expect to take a step forward to generate authentic human-like trackers. The database, toolkit, evaluation server, and baseline results are available at http://videocube.aitestunion.com.


title: Neuro-Inspired Deep Neural Networks with Sparse, Strong Activations

abstract: While end-to-end training of Deep Neural Networks (DNNs) yields state of the art performance in an increasing array of applications, it does not provide insight into, or control over, the features being extracted. We report here on a promising neuro-inspired approach to DNNs with sparser and stronger activations. We use standard stochastic gradient training, supplementing the end-to-end discriminative cost function with layer-wise costs promoting Hebbian ("fire together," "wire together") updates for highly active neurons, and anti-Hebbian updates for the remaining neurons. Instead of batch norm, we use divisive normalization of activations (suppressing weak outputs using strong outputs), along with implicit $\ell_2$ normalization of neuronal weights. Experiments with standard image classification tasks on CIFAR-10 demonstrate that, relative to baseline end-to-end trained architectures, our proposed architecture (a) leads to sparser activations (with only a slight compromise on accuracy), (b) exhibits more robustness to noise (without being trained on noisy data), (c) exhibits more robustness to adversarial perturbations (without adversarial training).


title: Non-isothermal non-Newtonian fluids: the stationary case

abstract: The stationary Navier-Stokes equations for a non-Newtonian incompressible fluid are coupled with the stationary heat equation and subject to Dirichlet type boundary conditions. The viscosity is supposed to depend on the temperature and the stress depends on the strain through a suit-able power law depending on $p \in (1,2)$ (shear thinning case). For this problem we establish the existence of a weak solution as well as we prove some regularity results both for the Navier-Stokes and the Stokes cases.Then, the latter case with the Carreau power law is approximated through a FEM scheme and some error estimates are obtained. Such estimates are then validated through some two-dimensional numerical experiments.


title: Utility and Feasibility of a Center Surround Event Camera

abstract: Standard dynamic vision sensor (DVS) event cameras output a stream of spatially-independent log-intensity brightness change events so they cannot suppress spatial redundancy. Nearly all biological retinas use an antagonistic center-surround organization. This paper proposes a practical method of implementing a compact, energy-efficient Center Surround DVS (CSDVS) with a surround smoothing network that uses compact polysilicon resistors for lateral resistance. The paper includes behavioral simulation results for the CSDVS (see sites.google.com/view/csdvs/home). The CSDVS would significantly reduce events caused by low spatial frequencies, but amplify the informative high frequency spatiotemporal events.


title: An insight into the $q$-difference two-dimensional Toda lattice equation, $q$-difference sine-Gordon equation and their integrability

abstract: In our previous work \cite{LNS}, we constructed quasi-Casoratian solutions to the noncommutative $q$-difference two-dimensional Toda lattice ($q$-2DTL) equation by Darboux transformation, which we can prove produces the existing Casoratian solutions to the bilinear $q$-2DTL equation obtained by Hirota's bilinear method in commutative setting. It is actually true that one can not only construct solutions to soliton equations but also solutions to their corresponding B$\ddot{a}$cklund transformations by their Darboux transformations and binary Darboux transformations. To be more specific, eigenfunctions produced by iterating Darboux transformations and binary Darboux transformations for soliton equations give nothing but determinant solutions to their B$\ddot{a}$cklund transformations, individually. This reveals the profound connections between Darboux transformations and Hirota's bilinear method. In this paper, we shall expound this viewpoint in the case of the $q$-2DTL equation. First, we derive a generalized bilinear B$\ddot{a}$cklund transformation and thus a generalized Lax pair for the bilinear $q$-2DTL equation. And then we successfully construct the binary Darboux transformation for the $q$-2DTL equation, based on which, Grammian solutions expressed in terms of quantum integrals are established for both the bilinear $q$-2DTL equation and its bilinear B$\ddot{a}$cklund transformation. In the end, by imposing the 2-periodic reductions on the corresponding results of the $q$-2DTL equation, we derive a $q$-difference sine-Gordon equation, a modified $q$-difference sine-Gordon equation and obtain their corresponding solutions.


title: SWIS: Self-Supervised Representation Learning For Writer Independent Offline Signature Verification

abstract: Writer independent offline signature verification is one of the most challenging tasks in pattern recognition as there is often a scarcity of training data. To handle such data scarcity problem, in this paper, we propose a novel self-supervised learning (SSL) framework for writer independent offline signature verification. To our knowledge, this is the first attempt to utilize self-supervised setting for the signature verification task. The objective of self-supervised representation learning from the signature images is achieved by minimizing the cross-covariance between two random variables belonging to different feature directions and ensuring a positive cross-covariance between the random variables denoting the same feature direction. This ensures that the features are decorrelated linearly and the redundant information is discarded. Through experimental results on different data sets, we obtained encouraging results.


title: Bi-directional Joint Neural Networks for Intent Classification and Slot Filling

abstract: Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint models for intent classification and slot filling have achieved state-of-the-art performance, and have proved that there exists a strong relationship between the two tasks. In this paper, we propose a bi-directional joint model for intent classification and slot filling, which includes a multi-stage hierarchical process via BERT and bi-directional joint natural language understanding mechanisms, including intent2slot and slot2intent, to obtain mutual performance enhancement between intent classification and slot filling. The evaluations show that our model achieves state-of-the-art results on intent classification accuracy, slot filling F1, and significantly improves sentence-level semantic frame accuracy when applied to publicly available benchmark datasets, ATIS (88.6%) and SNIPS (92.8%).


title: Improved Hard Example Mining Approach for Single Shot Object Detectors

abstract: Hard example mining methods generally improve the performance of the object detectors, which suffer from imbalanced training sets. In this work, two existing hard example mining approaches (LRM and focal loss, FL) are adapted and combined in a state-of-the-art real-time object detector, YOLOv5. The effectiveness of the proposed approach for improving the performance on hard examples is extensively evaluated. The proposed method increases mAP by 3% compared to using the original loss function and around 1-2% compared to using the hard-mining methods (LRM or FL) individually on 2021 Anti-UAV Challenge Dataset.


title: An Improved Deep Learning Approach For Product Recognition on Racks in Retail Stores

abstract: Automated product recognition in retail stores is an important real-world application in the domain of Computer Vision and Pattern Recognition. In this paper, we consider the problem of automatically identifying the classes of the products placed on racks in retail stores from an image of the rack and information about the query/product images. We improve upon the existing approaches in terms of effectiveness and memory requirement by developing a two-stage object detection and recognition pipeline comprising of a Faster-RCNN-based object localizer that detects the object regions in the rack image and a ResNet-18-based image encoder that classifies the detected regions into the appropriate classes. Each of the models is fine-tuned using appropriate data sets for better prediction and data augmentation is performed on each query image to prepare an extensive gallery set for fine-tuning the ResNet-18-based product recognition model. This encoder is trained using a triplet loss function following the strategy of online-hard-negative-mining for improved prediction. The proposed models are lightweight and can be connected in an end-to-end manner during deployment for automatically identifying each product object placed in a rack image. Extensive experiments using Grozi-32k and GP-180 data sets verify the effectiveness of the proposed model.


title: A dispersive analysis of low energy pion photo- and electroproduction

abstract: A dispersive representation based on unitarity and analyticity is used to study the low energy $\gamma N \to \pi N\ \text{and}\ \gamma^* N \to \pi N$ partial wave amplitudes. Final state interactions of the $\pi N$ system are critical to this analysis. The left-hand cut contribution is estimated by invoking baryon chiral perturbation theory results, while the right-hand cut contribution responsible for final state interaction effects is taken into account via an Omn\`{e}s formalism with elastic phase shifts as input. It is found that a good numerical fit can be achieved with only one subtraction parameter, and the experimental data of the multipole amplitudes $E_{0+}, S_{0+}$ in the energy region below the $\Delta (1232)$ are well described when the photon virtuality $Q^2 \leq 0.1 \mathrm{GeV}^2$. Furthermore, we extend the partial wave amplitudes to the second Riemann sheet to extract the couplings of the subthreshold resonance $N^*(890)$. Its couplings extracted from the multipole amplitudes $E_{0+}, S_{0+}$ are comparable to those of the $N^* (1535)$ resonance.


title: Multi-Level Contrastive Learning for Cross-Lingual Alignment

abstract: Cross-language pre-trained models such as multilingual BERT (mBERT) have achieved significant performance in various cross-lingual downstream NLP tasks. This paper proposes a multi-level contrastive learning (ML-CTL) framework to further improve the cross-lingual ability of pre-trained models. The proposed method uses translated parallel data to encourage the model to generate similar semantic embeddings for different languages. However, unlike the sentence-level alignment used in most previous studies, in this paper, we explicitly integrate the word-level information of each pair of parallel sentences into contrastive learning. Moreover, cross-zero noise contrastive estimation (CZ-NCE) loss is proposed to alleviate the impact of the floating-point error in the training process with a small batch size. The proposed method significantly improves the cross-lingual transfer ability of our basic model (mBERT) and outperforms on multiple zero-shot cross-lingual downstream tasks compared to the same-size models in the Xtreme benchmark.


title: Visual Speech Recognition for Multiple Languages in the Wild

abstract: Visual speech recognition (VSR) aims to recognize the content of speech based on lip movements, without relying on the audio stream. Advances in deep learning and the availability of large audio-visual datasets have led to the development of much more accurate and robust VSR models than ever before. However, these advances are usually due to the larger training sets rather than the model design. Here we demonstrate that designing better models is equally as important as using larger training sets. We propose the addition of prediction-based auxiliary tasks to a VSR model, and highlight the importance of hyperparameter optimization and appropriate data augmentations. We show that such a model works for different languages and outperforms all previous methods trained on publicly available datasets by a large margin. It even outperforms models that were trained on non-publicly available datasets containing up to to 21 times more data. We show, furthermore, that using additional training data, even in other languages or with automatically generated transcriptions, results in further improvement.


title: Design-based composite estimation of small proportions in small domains

abstract: Traditional direct estimation methods are not efficient for domains of a survey population with small sample sizes. To estimate the domain proportions, we combine the direct estimators and the regression-synthetic estimators based on domain-level auxiliary information. For the case of small true proportions, we introduce the design-based linear combination that is a robust alternative to the empirical best linear unbiased predictor (EBLUP) based on the Fay--Herriot model. We also consider an adaptive procedure optimizing a sample-size-dependent composite estimator, which depends on a single parameter for all domains. We imitate the Lithuanian Labor Force Survey, where we estimate the proportions of the unemployed and employed in municipalities. We show where the considered design-based compositions and estimators of their mean square errors are competitive for EBLUP and its accuracy estimation.


title: Scattering of fermionic isodoublets on the sine-Gordon kink

abstract: The scattering of Dirac fermions on the sine-Gordon kink is studied both analytically and numerically. To achieve invariance with respect to a discrete symmetry, the sine-Gordon model is treated as a nonlinear $\sigma$-model with a circular target space that interacts with fermionic isodublets through the Yukawa interaction. It is shown that the diagonal and antidiagonal parts of the fermionic wave function interact independently with the external field of the sine-Gordon kink. The wave functions of the fermionic scattering states are expressed in terms of the Heun functions. General expressions for the transmission and reflection coefficients are derived, and their dependences on the fermion momentum and mass are studied numerically. The existence condition is found for two fermionic zero modes, and their analytical expressions are obtained. It is shown that the zero modes do not lead to fragmentation of the fermionic charge, but can lead to polarization of the fermionic vacuum. The scattering of the diagonal and antidiagonal fermionic states is found to be significantly different; this difference is shown to be due to the different dependences of the energy levels of these bound states on the fermion mass, and is in accordance with Levinson's theorem.


title: Predicting the formation and stability of oxide perovskites by extracting underlying mechanisms using machine learning

abstract: The optimization of properties of perovskite oxides has drawn interest on account of their diverse areas of application. In this work, the hierarchical clustering technique is used to reduce the multi-collinearity among selected features from literature that are reported to have an effect on perovskite formation and stability. Operating on the vast composition space of double oxide perovskite compositions available in literature and online repositories, in this manuscript, an attempt has been made to extract the relationship between the composition and structure to predict their formability and stability. Machine learning (ML) classifiers are trained on these datasets to predict novel stable perovskite compositions. The study uses a vast feature space to narrow down the most important factors affecting the formability and stability in perovskite compounds. It also identifies stable compositions that have band gaps suitable for photovoltaic and photocatalytic applications. The developed random forest (RF)-based models may be extended to include the implications beyond photosensitive applications by focusing on the physico-chemical mechanisms driving the phenomena behind each application.


title: Almost Tight Approximation Hardness for Single-Source Directed k-Edge-Connectivity

abstract: In the $k$-connected directed Steiner tree problem ($k$-DST), we are given an $n$-vertex directed graph $G=(V,E)$ with edge costs, a connectivity requirement $k$, a root $r\in V$ and a set of terminals $T\subseteq V$. The goal is to find a minimum-cost subgraph $H\subseteq G$ that has $k$ internally disjoint paths from the root vertex $r$ to every terminal $t\in T$. In this paper, we show the approximation hardness of $k$-DST for various parameters, which thus close some long-standing open problems. - $\Omega\left(|T|/\log |T|\right)$-approximation hardness, which holds under the standard assumption $\mathrm{NP}\neq \mathrm{ZPP}$. The inapproximability ratio is tightened to $\Omega\left(|T|\right)$ under the Strongish Planted Clique Hypothesis [Manurangsi, Rubinstein and Schramm, ITCS 2021]. The latter hardness result matches the approximation ratio of $|T|$ obtained by a trivial approximation algorithm, thus closing the long-standing open problem. - $\Omega\left(\sqrt{2}^k / k\right)$-approximation hardness for the general case of $k$-DST under the assumption $\mathrm{NP}\neq\mathrm{ZPP}$. This is the first hardness result known for survivable network design problems with an inapproximability ratio exponential in $k$. - $\Omega\left((k/L)^{L/4}\right)$-approximation hardness for $k$-DST on $L$-layered graphs for $L\le O\left(\log n\right)$. This almost matches the approximation ratio of $O(k^{L-1}\cdot L \cdot \log |T|)$ achieving in $O\left(n^L\right)$-time due to Laekhanukit [ICALP`16].


title: Stable and metastable contract networks

abstract: We consider a hypergraph (I,C), with possible multiple (hyper)edges and loops, in which the vertices $i\in I$ are interpreted as agents, and the edges $c\in C$ as contracts that can be concluded between agents. The preferences of each agent i concerning the contracts where i takes part are given by use of a choice function $f_i$ possessing the so-called path independent property. In this general setup we introduce the notion of stable network of contracts. The paper contains two main results. The first one is that a general problem on stable systems of contracts for (I,C,f) is reduced to a set of special ones in which preferences of agents are described by use of so-called weak orders, or utility functions. However, for a special case of this sort, the stability may not exist. Trying to overcome this trouble when dealing with such special cases, we introduce a weaker notion of metastability for systems of contracts. Our second result is that a metastable system always exists.


title: Disentangling Long and Short-Term Interests for Recommendation

abstract: Modeling user's long-term and short-term interests is crucial for accurate recommendation. However, since there is no manually annotated label for user interests, existing approaches always follow the paradigm of entangling these two aspects, which may lead to inferior recommendation accuracy and interpretability. In this paper, to address it, we propose a Contrastive learning framework to disentangle Long and Short-term interests for Recommendation (CLSR) with self-supervision. Specifically, we first propose two separate encoders to independently capture user interests of different time scales. We then extract long-term and short-term interests proxies from the interaction sequences, which serve as pseudo labels for user interests. Then pairwise contrastive tasks are designed to supervise the similarity between interest representations and their corresponding interest proxies. Finally, since the importance of long-term and short-term interests is dynamically changing, we propose to adaptively aggregate them through an attention-based network for prediction. We conduct experiments on two large-scale real-world datasets for e-commerce and short-video recommendation. Empirical results show that our CLSR consistently outperforms all state-of-the-art models with significant improvements: GAUC is improved by over 0.01, and NDCG is improved by over 4%. Further counterfactual evaluations demonstrate that stronger disentanglement of long and short-term interests is successfully achieved by CLSR. The code and data are available at https://github.com/tsinghua-fib-lab/CLSR.


title: The dimension of Kronheimer-Mrowka instanton homology group for plane trivalent graphs

abstract: We proved that the dimension of the F-vector space J#(G) for a plane trivalent graph G, defined by Kronheimer and Mrowka using their SO(3) instanton Floer homology, is equal to the number of Tait colorings of G.


title: Investigation of Optimization Techniques on the Elevator Dispatching Problem

abstract: In the elevator industry, reducing passenger journey time in an elevator system is a major aim. The key obstacle to optimising elevator dispatching is the unpredictable traffic flow of passengers. To address this difficulty, two main features must be optimised: waiting time and journey time. To address the problem in real time, several strategies are employed, including Simulated Annealing (SA), Genetic Algorithm (GA), Particle Swarm Optimization Algorithm (PSO), and Whale Optimization Algorithm (WOA). This research article compares the algorithms discussed above. To investigate the functioning of the algorithms for visualisation and insight, a case study was created. In order to discover the optimum algorithm for the elevator dispatching problem, performance indices such as average and ideal fitness value are generated in 5 runs to compare the outcomes of the methods. The goal of this study is to compute a dispatching scheme, which is the result of the algorithms, in order to lower the average trip time for all passengers. This study builds on previous studies that recommended ways to reduce waiting time. The proposed technique reduces average wait time, improves lift efficiency, and improves customer experience.


title: Exploring the Impact of Negative Samples of Contrastive Learning: A Case Study of Sentence Embedding

abstract: Contrastive learning is emerging as a powerful technique for extracting knowledge from unlabeled data. This technique requires a balanced mixture of two ingredients: positive (similar) and negative (dissimilar) samples. This is typically achieved by maintaining a queue of negative samples during training. Prior works in the area typically uses a fixed-length negative sample queue, but how the negative sample size affects the model performance remains unclear. The opaque impact of the number of negative samples on performance when employing contrastive learning aroused our in-depth exploration. This paper presents a momentum contrastive learning model with negative sample queue for sentence embedding, namely MoCoSE. We add the prediction layer to the online branch to make the model asymmetric and together with EMA update mechanism of the target branch to prevent the model from collapsing. We define a maximum traceable distance metric, through which we learn to what extent the text contrastive learning benefits from the historical information of negative samples. Our experiments find that the best results are obtained when the maximum traceable distance is at a certain range, demonstrating that there is an optimal range of historical information for a negative sample queue. We evaluate the proposed unsupervised MoCoSE on the semantic text similarity (STS) task and obtain an average Spearman's correlation of $77.27\%$. Source code is available at https://github.com/xbdxwyh/mocose.