title: Broad-line Region Clouds orbiting an AGN sample

abstract: We present a spectral and temporal analysis of XMM-Newton data from a sample of six galaxies (NGC 3783, Mrk 279, Mrk 766, NGC 3227, NGC 7314, and NGC 3516). Using the hardness-ratio curves, we identify time-intervals in which clouds are eclipsing the central X-ray source in five of the six sources. We detect three occultations in NGC 3227 and one occultation in NGC 3783, NGC 7314, and NGC 3516, together with the well-known occultations in Mrk 766. We estimate the physical properties of the eclipsing clouds. The derived physical size of the X-ray sources ($\sim$(3-28)$\times$10$^{13}$ cm) is less than that of the eclipsing clouds with column densities of $\sim$10$^{22}$-10$^{23}$ cm$^{-2}$, thus a single cloud may block the X-ray source, leading to notorious temporal variability of the X-ray flux. The eclipsing clouds in Mrk 766, NGC 3227, NGC 7314, and NGC 3516 with distances from the X-ray source of $\sim$(0.3-3.6)$\times$10$^4$ $R_g$ are moving at Keplerian velocities $>$1122 km s$^{-1}$, typical parameters of broad-line region clouds, while the eclipsing cloud in NGC 3783 is likely located in the dusty torus. We also find a good anti-correlation with a slope of -187$\pm$62 between the known masses of the supermassive black hole in the center of the galaxies with the equivalent width (EW) of the 6.4 keV Fe line for the five Seyfert 1 galaxies of our sample, while the Seyfert 2 galaxy NGC 7314 shows an average EW value of 100$\pm$11 eV inconsistent with the above anti-correlation.


title: DProQ: A Gated-Graph Transformer for Protein Complex Structure Assessment

abstract: Proteins interact to form complexes to carry out essential biological functions. Computational methods have been developed to predict the structures of protein complexes. However, an important challenge in protein complex structure prediction is to estimate the quality of predicted protein complex structures without any knowledge of the corresponding native structures. Such estimations can then be used to select high-quality predicted complex structures to facilitate biomedical research such as protein function analysis and drug discovery. We challenge this significant task with DProQ, which introduces a gated neighborhood-modulating Graph Transformer (GGT) designed to predict the quality of 3D protein complex structures. Notably, we incorporate node and edge gates within a novel Graph Transformer framework to control information flow during graph message passing. We train and evaluate DProQ on four newly-developed datasets that we make publicly available in this work. Our rigorous experiments demonstrate that DProQ achieves state-of-the-art performance in ranking protein complex structures.


title: Real surreal trajectories in pilot-wave hydrodynamics

abstract: In certain instances, the particle paths predicted by Bohmian mechanics are thought to be at odds with classical intuition. A striking illustration arises in the interference experiments envisaged by Englert, Scully, S\"ussmann and Walther, which lead the authors to claim that the Bohmian trajectories can not be real and so must be `surreal'. Through a combined experimental and numerical study, we here demonstrate that individual trajectories in the hydrodynamic pilot-wave system exhibit the key features of their surreal Bohmian counterparts. These real surreal classical trajectories are rationalized in terms of the system's non-Markovian pilot-wave dynamics. Our study thus makes clear that the designation of Bohmian trajectories as surreal is based on misconceptions concerning the limitations of classical dynamics and a lack of familiarity with pilot-wave hydrodynamics.


title: User-Interactive Offline Reinforcement Learning

abstract: Offline reinforcement learning algorithms still lack trust in practice due to the risk that the learned policy performs worse than the original policy that generated the dataset or behaves in an unexpected way that is unfamiliar to the user. At the same time, offline RL algorithms are not able to tune their most important hyperparameter - the proximity of the learned policy to the original policy. We propose an algorithm that allows the user to tune this hyperparameter at runtime, thereby addressing both of the above mentioned issues simultaneously. This allows users to start with the original behavior and grant successively greater deviation, as well as stopping at any time when the policy deteriorates or the behavior is too far from the familiar one.


title: A note on the structure of expansive matrices in indefinite inner product spaces

abstract: A result on the structure of expansive matrices in an indefinite inner product space is derived, which exhibits the largest unitary compression of the matrix.


title: Astrophysical implications on hyperon couplings and hyperon star properties with relativistic equations of states

abstract: Hyperons are essential constituents in the neutron star interior. The poorly-known hyperonic interaction is a source of uncertainty for studying laboratory hypernuclei and neutron star observations. In this work, we perform Bayesian inference of phenomenological hyperon-nucleon interactions using the tidal-deformability measurement of the GW170817 binary neutron star merger as detected by LIGO/Virgo and the mass-radius measurements of PSR J0030+0541 and PSR J0740+6620 as detected by NICER. The analysis is based on a set of stiff relativistic neutron-star-matter equation of states with hyperons from the relativistic mean-field theory, naturally fulfilling the causality requirement and empirical nuclear matter properties. We specifically utilize the strong correlation recently deduced between the scalar and vector meson hyperon couplings, imposed by the measured $\Lambda$ separation energy in single-$\Lambda$ hypernuclei, and perform four different tests with or without the strong correlation. We find that the laboratory hypernuclear constraint ensures a large enough $\Lambda$-scalar-meson coupling to match the large vector coupling in hyperon star matter. When adopting the current most probable intervals of hyperon couplings from the joint analysis of laboratory and astrophysical data, we find the maximum mass of hyperon stars is at most $2.176^{+0.085}_{-0.202}M_{\odot}$ ($68\%$ credible interval) from the chosen set of stiff equation of states. The reduction of the stellar radius due to hyperons is quantified based on our analysis and various hyperon star properties are provided.


title: Logic of the Ontological Argument

abstract: In his ontological argument G\"{o}del says nothing about its underlying logic. The argument is modal and at least of second-order and since S5 axiom is used so it is widely accepted that the logic of the argument is the S5 second-order modal logic. However, there is a step in the proof in which G\"{o}del applies the necessitation rule on the assumptions of the argument. This is repeated by all of his followers. This application of the necessitation rule can seriously harm the consequence relation of the logic of the ontological argument. It seems that the only way to preserve the modal logic S5 for the ontological argument is to assume some of its axioms in the necessitated form.


title: Certain properties of Generalization of $L^p-$Spaces for $0 < p < 1$

abstract: This paper introduces the notion of $N^*-$function and gives a generalization of $L^p,$ for $0<p<1$ denoted by $L_\Phi$ where $\Phi$ is an $N^*-$function. As well as, this paper examines some properties regarding to this generalized spaces and its linear forms, including some analogies and common features to some other well known spaces. As well as, we prove this space is a quasi-normed space but it is not normed space.


title: New quality measures for quadrilaterals and new discrete functionals for grid generation

abstract: In this paper, we review some grid quality metrics Robinson1987, Lo1989, Field2000, Knupp2001, Remacle2012 and define some new quality measures for quadrilateral elements. Usually, a maximum value of a quality measure corresponds to the minimum value of the energy density over the grid Ivanenko2000. We also define new discrete functionals which are implemented as objective functions in an optimization-based method for quadrilateral grid generation and improvement. These functionals are linearly combined with a discrete functional whose domain has an infinite barrier at the boundary of the set of unfolded grids like $S_{\omega,\epsilon}(G)$, see Barrera2010, in order to preserve convex grid cells in each step of the optimization process.


title: SplitPlace: AI Augmented Splitting and Placement of Large-Scale Neural Networks in Mobile Edge Environments

abstract: In recent years, deep learning models have become ubiquitous in industry and academia alike. Deep neural networks can solve some of the most complex pattern-recognition problems today, but come with the price of massive compute and memory requirements. This makes the problem of deploying such large-scale neural networks challenging in resource-constrained mobile edge computing platforms, specifically in mission-critical domains like surveillance and healthcare. To solve this, a promising solution is to split resource-hungry neural networks into lightweight disjoint smaller components for pipelined distributed processing. At present, there are two main approaches to do this: semantic and layer-wise splitting. The former partitions a neural network into parallel disjoint models that produce a part of the result, whereas the latter partitions into sequential models that produce intermediate results. However, there is no intelligent algorithm that decides which splitting strategy to use and places such modular splits to edge nodes for optimal performance. To combat this, this work proposes a novel AI-driven online policy, SplitPlace, that uses Multi-Armed-Bandits to intelligently decide between layer and semantic splitting strategies based on the input task's service deadline demands. SplitPlace places such neural network split fragments on mobile edge devices using decision-aware reinforcement learning for efficient and scalable computing. Moreover, SplitPlace fine-tunes its placement engine to adapt to volatile environments. Our experiments on physical mobile-edge environments with real-world workloads show that SplitPlace can significantly improve the state-of-the-art in terms of average response time, deadline violation rate, inference accuracy, and total reward by up to 46, 69, 3 and 12 percent respectively.


title: AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints

abstract: Structured representations such as keypoints are widely used in pose transfer, conditional image generation, animation, and 3D reconstruction. However, their supervised learning requires expensive annotation for each target domain. We propose a self-supervised method that learns to disentangle object structure from the appearance with a graph of 2D keypoints linked by straight edges. Both the keypoint location and their pairwise edge weights are learned, given only a collection of images depicting the same object class. The resulting graph is interpretable, for example, AutoLink recovers the human skeleton topology when applied to images showing people. Our key ingredients are i) an encoder that predicts keypoint locations in an input image, ii) a shared graph as a latent variable that links the same pairs of keypoints in every image, iii) an intermediate edge map that combines the latent graph edge weights and keypoint locations in a soft, differentiable manner, and iv) an inpainting objective on randomly masked images. Although simpler, AutoLink outperforms existing self-supervised methods on the established keypoint and pose estimation benchmarks and paves the way for structure-conditioned generative models on more diverse datasets. Project website: https://xingzhehe.github.io/autolink/.


title: Symmetry Teleportation for Accelerated Optimization

abstract: Existing gradient-based optimization methods update parameters locally, in a direction that minimizes the loss function. We study a different approach, symmetry teleportation, that allows parameters to travel a large distance on the loss level set, in order to improve the convergence speed in subsequent steps. Teleportation exploits symmetries in the loss landscape of optimization problems. We derive loss-invariant group actions for test functions in optimization and multi-layer neural networks, and prove a necessary condition for teleportation to improve convergence rate. We also show that our algorithm is closely related to second order methods. Experimentally, we show that teleportation improves the convergence speed of gradient descent and AdaGrad for several optimization problems including test functions, multi-layer regressions, and MNIST classification.


title: Disjoint strong transitivity of composition operators

abstract: A Furstenberg family $\mathcal{F}$ is a collection of infinite subsets of the set of positive integers such that if $A\subset B$ and $A\in \mathcal{F}$, then $B\in \mathcal{F}$. For a Furstenberg family $\mathcal{F}$, finitely many operators $T_1,...,T_N$ acting on a common topological vector space $X$ are said to be disjoint $\mathcal{F}$-transitive if for every non-empty open subsets $U_0,...,U_N$ of $X$ the set $\{n\in \mathbb{N}:\ U_0 \cap T_1^{-n}(U_1)\cap...\cap T_N^{-n}(U_N)\neq\emptyset\}$ belongs to $\mathcal{F}$. In this paper, depending on the topological properties of $\Omega$, we characterize the disjoint $\mathcal{F}$-transitivity of $N\geq2$ composition operators $C_{\phi_1},\ldots,C_{\phi_N}$ acting on the space $H(\Omega)$ of holomorphic maps on a domain $\Omega\subset \mathbb{C}$ by establishing a necessary and sufficient condition in terms of their symbols $\phi_1,...,\phi_N$.


title: A Flexible Bayesian Clustering of Dynamic Subpopulations in Neural Spiking Activity

abstract: With advances in neural recording techniques, neuroscientists are now able to record the spiking activity of many hundreds of neurons simultaneously, and new statistical methods are needed to understand the structure of this large-scale neural population activity. Although previous work has tried to summarize neural activity within and between known populations by extracting low-dimensional latent factors, in many cases what determines a unique population may be unclear. Neurons differ in their anatomical location, but also, in their cell types and response properties. To identify populations directly related to neural activity, we develop a clustering method based on a mixture of dynamic Poisson factor analyzers (mixDPFA) model, with the number of clusters and dimension of latent factors for each cluster treated as unknown parameters. To analyze the proposed mixDPFA model, we propose a Markov chain Monte Carlo (MCMC) algorithm to efficiently sample its posterior distribution. Validating our proposed MCMC algorithm through simulations, we find that it can accurately recover the unknown parameters and the true clustering in the model, and is insensitive to the initial cluster assignments. We then apply the proposed mixDPFA model to multi-region experimental recordings, where we find that the proposed method can identify novel, reliable clusters of neurons based on their activity, and may, thus, be a useful tool for neural data analysis.


title: Learning to Dynamically Select Cost Optimal Schedulers in Cloud Computing Environments

abstract: The operational cost of a cloud computing platform is one of the most significant Quality of Service (QoS) criteria for schedulers, crucial to keep up with the growing computational demands. Several data-driven deep neural network (DNN)-based schedulers have been proposed in recent years that outperform alternative approaches by providing scalable and effective resource management for dynamic workloads. However, state-of-the-art schedulers rely on advanced DNNs with high computational requirements, implying high scheduling costs. In non-stationary contexts, the most sophisticated schedulers may not always be required, and it may be sufficient to rely on low-cost schedulers to temporarily save operational costs. In this work, we propose MetaNet, a surrogate model that predicts the operational costs and scheduling overheads of a large number of DNN-based schedulers and chooses one on-the-fly to jointly optimize job scheduling and execution costs. This facilitates improvements in execution costs, energy usage and service level agreement violations of up to 11%, 43% and 13% compared to the state-of-the-art methods.


title: Potential Global Sequestration of Atmospheric Carbon Dioxide by Semi-Arid Forestation

abstract: Carbon sequestration was studied in the planted Israeli Yatir forest, a 28 ${km}^2$ Aleppo pine forest growing at the semi-arid timberline (with no irrigation or fertilization). The organic carbon sequestration rate (above and below ground) was measured as 550 gram $CO_2 {m}^{-2} {yr}^{-1}$, by Eddy Covariance flux and Carbon Stock counting methods. Assuming that the soil composition at Yatir is representative, we estimate a global organic sequestration rate of roughly 3.0 billion tons $CO_2$ per year, after future global forestation, by extrapolating to 20% of the global semi-arid area. Consider now the inorganic carbon sequestration rate. $CO_2$ exhaled into the soil by tree roots is hydrated by soil water to produce mainly bicarbonate ${{HCO}_3}^-$, which combines with soil ${Ca}^{2+}$ to precipitate calcite ${CaCO}_3$. We quantify the annual sequestration rate in Yatir soil cores by measuring the decreased density versus depth, of bicarbonates in the liquid phase of the soil unsaturated zone (USZ). We found that the bicarbonate concentration decreases with depth, as the calcite precipitates and is incorporated within the USZ. The depth profiles were converted to time profiles, taking into account the $\approx 11 cm/yr$ annual rate of downward water percolation at Yatir. In 1 Liter of sediment, using data from a core depth of 2.2 meters, the calcite precipitation rate was measured as 22 mg $CO_2 {yr}^{-1} L^{-1}$. Taking 6 m as the global semi-arid average depth of root respiration, extrapolating as above, roughly 0.8 billion tons of $CO_2$ could potentially be sequestered globally each year. The total organic plus inorganic sequestration rate is then $\approx 4$ billion tons $CO_2$ per year. This demonstrates the global potential, the need for further measurements, and the need to begin implementing a global land management policy of widespread tree planting in semi-arid regions.


title: MetaNet: Automated Dynamic Selection of Scheduling Policies in Cloud Environments

abstract: Task scheduling is a well-studied problem in the context of optimizing the Quality of Service (QoS) of cloud computing environments. In order to sustain the rapid growth of computational demands, one of the most important QoS metrics for cloud schedulers is the execution cost. In this regard, several data-driven deep neural networks (DNNs) based schedulers have been proposed in recent years to allow scalable and efficient resource management in dynamic workload settings. However, optimal scheduling frequently relies on sophisticated DNNs with high computational needs implying higher execution costs. Further, even in non-stationary environments, sophisticated schedulers might not always be required and we could briefly rely on low-cost schedulers in the interest of cost-efficiency. Therefore, this work aims to solve the non-trivial meta problem of online dynamic selection of a scheduling policy using a surrogate model called MetaNet. Unlike traditional solutions with a fixed scheduling policy, MetaNet on-the-fly chooses a scheduler from a large set of DNN based methods to optimize task scheduling and execution costs in tandem. Compared to state-of-the-art DNN schedulers, this allows for improvement in execution costs, energy consumption, response time and service level agreement violations by up to 11, 43, 8 and 13 percent, respectively.


title: Self-Supervised Speech Representation Learning: A Review

abstract: Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and languages for which only limited labeled data is available. Self-supervised representation learning methods promise a single universal model that would benefit a wide variety of tasks and domains. Such methods have shown success in natural language processing and computer vision domains, achieving new levels of performance while reducing the number of labels required for many downstream scenarios. Speech representation learning is experiencing similar progress in three main categories: generative, contrastive, and predictive methods. Other approaches rely on multi-modal data for pre-training, mixing text or visual data streams with speech. Although self-supervised speech representation is still a nascent research area, it is closely related to acoustic word embedding and learning with zero lexical resources, both of which have seen active research for many years. This review presents approaches for self-supervised speech representation learning and their connection to other research areas. Since many current methods focus solely on automatic speech recognition as a downstream task, we review recent efforts on benchmarking learned representations to extend the application beyond speech recognition.


title: Unification types and union splittings in intermediate logics

abstract: Following a characterization [10] of locally tabular logics with finitary (or unitary) unification by their Kripke models we determine the unification types of some intermediate logics (extensions of {\sf INT}). There are exactly four maximal logics with nullary unification ${\mathsf L}(\mathfrak R_{2}+)$, ${\mathsf L}(\mathfrak R_{2})\cap{\mathsf L}(\mathfrak F_{2})$, ${\mathsf L}(\mathfrak G_{3})$ and ${\mathsf L}(\mathfrak G_{3}+)$ and they are tabular. There are only two minimal logics with hereditary finitary unification: ${\mathsf L}$($\mathbf F_{un}$), the least logic with hereditary unitary unification, and ${\mathsf L}$( $\mathbf F_{pr}$) the least logic with hereditary projective approximation; they are locally tabular. Unitary and non-projective logics need additional variables for mgu's of some unifiable formulas, and unitary logics with projective approximation are exactly projective. None of locally tabular intermediate logics has infinitary unification. Logics with finitary, but not hereditary finitary, unification are rare and scattered among the majority of those with nullary unification, see the example of $\mathsf H_3\mathsf B_2$ and its extensions.


title: The distance to the border of a random tree

abstract: Given a Galton-Watson process conditioned to have total progeny equal to $n$, we study the asymptotic probability that this conditioned Galton-Watson process has distance to the border bigger or equal than $k$, as the number of nodes $n \rightarrow \infty$. A problem which is akin to this one was solved by R\'enyi and Szekeres for Cayley trees, de Bruijn, Knuth, and Rice for plane trees and Flajolet, Gao, Odlyzko, and Richmond for binary trees. The distance to the border is dual, in a certain sense, to the height. The first of these distances is the minimum of the distances from the root to the leaves. The second is the maximum of the distances from the root to the leaves. These are two extreme complementary cases.


title: Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metrics

abstract: Few images on the Web receive alt-text descriptions that would make them accessible to blind and low vision (BLV) users. Image-based NLG systems have progressed to the point where they can begin to address this persistent societal problem, but these systems will not be fully successful unless we evaluate them on metrics that guide their development correctly. Here, we argue against current referenceless metrics -- those that don't rely on human-generated ground-truth descriptions -- on the grounds that they do not align with the needs of BLV users. The fundamental shortcoming of these metrics is that they do not take context into account, whereas contextual information is highly valued by BLV users. To substantiate these claims, we present a study with BLV participants who rated descriptions along a variety of dimensions. An in-depth analysis reveals that the lack of context-awareness makes current referenceless metrics inadequate for advancing image accessibility. As a proof-of-concept, we provide a contextual version of the referenceless metric CLIPScore which begins to address the disconnect to the BLV data. An accessible HTML version of this paper is available at https://elisakreiss.github.io/contextual-description-evaluation/paper/reflessmetrics.html


title: Identifying and Mitigating Instability in Embeddings of the Degenerate Core

abstract: Are the embeddings of a graph's degenerate core stable? What happens to the embeddings of nodes in the degenerate core as we systematically remove periphery nodes (by repeated peeling off $k$-cores)? We discover three patterns w.r.t. instability in degenerate-core embeddings across a variety of popular graph embedding algorithms and datasets. We use regression to quantify the change point in graph embedding stability. Furthermore, we present the STABLE algorithm, which takes an existing graph embedding algorithm and makes it stable. We show the effectiveness of STABLE in terms of making the degenerate-core embedding stable and still producing state-of-the-art link prediction performance.


title: Global reconstruction of initial conditions of nonlinear parabolic equations via the Carleman-contraction method

abstract: We propose a global convergent numerical method to reconstruct the initial condition of a nonlinear parabolic equation from the measurement of both Dirichlet and Neumann data on the boundary of a bounded domain. The first step in our method is to derive, from the nonlinear governing parabolic equation, a nonlinear systems of elliptic partial differential equations (PDEs) whose solution yields directly the solution of the inverse source problem. We then establish a contraction mapping-like iterative scheme to solve this system. The convergence of this iterative scheme is rigorously proved by employing a Carleman estimate and the argument in the proof of the traditional contraction mapping principle. This convergence is fast in both theoretical and numerical senses. Moreover, our method, unlike the methods based on optimization, does not require a good initial guess of the true solution. Numerical examples are presented to verify these results.


title: Towards the Effects of Alignment Edits on the Quality of Experience of 360 Videos

abstract: The optimization of viewers' quality of experience (QoE) in 360 videos faces two major roadblocks: inaccurate adaptive streaming and viewers missing the plot of a story. Alignment edit emerged as a promising mechanism to avoid both issues at once. Alignment edits act on the content, matching the users' viewport with a region of interest in the video content. As a consequence, viewers' attention is focused, reducing exploratory behavior and enabling the optimization of network resources; in addition, it allows for a precise selection of events to be shown to viewers, supporting viewers to follow the storyline. In this work, we investigate the effects of alignment edits on QoE by conducting two user studies. Specifically, we measured three QoE factors: presence, comfort, and overall QoE. We introduce a new alignment edit, named \textit{Fade-rotation}, based on a mechanism to reduce cybersickness in VR games. In the user studies, we tested four versions of fade-rotation and compared them with instant alignment. We observed from the results that gradual alignment achieves good levels of comfort for all contents and rotational speed tested, showing its validity. We observed a decrease in head motion after both alignment edits, with the gradual edit reaching a reduction in head speed of 8\% greater than that of instant alignment, confirming the usefulness of these edits for streaming video on-demand. Finally, parameters to implement \textit{Fade-rotation} are described.


title: Transformer-based out-of-distribution detection for clinically safe segmentation

abstract: In a clinical setting it is essential that deployed image processing systems are robust to the full range of inputs they might encounter and, in particular, do not make confidently wrong predictions. The most popular approach to safe processing is to train networks that can provide a measure of their uncertainty, but these tend to fail for inputs that are far outside the training data distribution. Recently, generative modelling approaches have been proposed as an alternative; these can quantify the likelihood of a data sample explicitly, filtering out any out-of-distribution (OOD) samples before further processing is performed. In this work, we focus on image segmentation and evaluate several approaches to network uncertainty in the far-OOD and near-OOD cases for the task of segmenting haemorrhages in head CTs. We find all of these approaches are unsuitable for safe segmentation as they provide confidently wrong predictions when operating OOD. We propose performing full 3D OOD detection using a VQ-GAN to provide a compressed latent representation of the image and a transformer to estimate the data likelihood. Our approach successfully identifies images in both the far- and near-OOD cases. We find a strong relationship between image likelihood and the quality of a model's segmentation, making this approach viable for filtering images unsuitable for segmentation. To our knowledge, this is the first time transformers have been applied to perform OOD detection on 3D image data. Code is available at github.com/marksgraham/transformer-ood.


title: Tensor Shape Search for Optimum Data Compression

abstract: Various tensor decomposition methods have been proposed for data compression. In real world applications of the tensor decomposition, selecting the tensor shape for the given data poses a challenge and the shape of the tensor may affect the error and the compression ratio. In this work, we study the effect of the tensor shape on the tensor decomposition and propose an optimization model to find an optimum shape for the tensor train (TT) decomposition. The proposed optimization model maximizes the compression ratio of the TT decomposition given an error bound. We implement a genetic algorithm (GA) linked with the TT-SVD algorithm to solve the optimization model. We apply the proposed method for the compression of RGB images. The results demonstrate the effectiveness of the proposed evolutionary tensor shape search for the TT decomposition.


title: Are Message Passing Neural Networks Really Helpful for Knowledge Graph Completion?

abstract: Knowledge graphs (KGs) facilitate a wide variety of applications. Despite great efforts in creation and maintenance, even the largest KGs are far from complete. Hence, KG completion (KGC) has become one of the most crucial tasks for KG research. Recently, considerable literature in this space has centered around the use of Message Passing (Graph) Neural Networks (MPNNs), to learn powerful embeddings. The success of these methods is naturally attributed to the use of MPNNs over simpler multi-layer perceptron (MLP) models, given their additional message passing (MP) component. In this work, we find that surprisingly, simple MLP models are able to achieve comparable performance to MPNNs, suggesting that MP may not be as crucial as previously believed. With further exploration, we show careful scoring function and loss function design has a much stronger influence on KGC model performance. This suggests a conflation of scoring function design, loss function design, and MP in prior work, with promising insights regarding the scalability of state-of-the-art KGC methods today, as well as careful attention to more suitable MP designs for KGC tasks tomorrow. Our codes are publicly available at: https://github.com/Juanhui28/Are_MPNNs_helpful.


title: Towards real-time and energy efficient Siamese tracking -- a hardware-software approach

abstract: Siamese trackers have been among the state-of-the-art solutions in each Visual Object Tracking (VOT) challenge over the past few years. However, with great accuracy comes great computational complexity: to achieve real-time processing, these trackers have to be massively parallelised and are usually run on high-end GPUs. Easy to implement, this approach is energy consuming, and thus cannot be used in many low-power applications. To overcome this, one can use energy-efficient embedded devices, such as heterogeneous platforms joining the ARM processor system with programmable logic (FPGA). In this work, we propose a hardware-software implementation of the well-known fully connected Siamese tracker (SiamFC). We have developed a quantised Siamese network for the FINN accelerator, using algorithm-accelerator co-design, and performed design space exploration to achieve the best efficiency-to-energy ratio (determined by FPS and used resources). For our network, running in the programmable logic part of the Zynq UltraScale+ MPSoC ZCU104, we achieved the processing of almost 50 frames-per-second with tracker accuracy on par with its floating point counterpart, as well as the original SiamFC network. The complete tracking system, implemented in ARM with the network accelerated on FPGA, achieves up to 17 fps. These results bring us towards bridging the gap between the highly accurate but energy-demanding algorithms and energy-efficient solutions ready to be used in low-power, edge systems.


title: Classification of Stationary distributions for the stochastic vertex models

abstract: In this paper, we study the stationary distributions for the stochastic vertex models. Our main focus is the stochastic six vertex (S6V) model. We show that the extremal stationary distributions of the S6V model are given by product Bernoulli measures. Moreover, for the S6V model under a moving frame of speed $1$, we show that the extremal stationary distributions are given by product Bernoulli measures and blocking measures. Finally, we generalize our results to the stochastic higher spin six vertex model. Our proof relies on the coupling of the S6V models introduced in [Aggarwal, 2020], the analysis of current and the method of fusion.


title: Swept-Angle Synthetic Wavelength Interferometry

abstract: We present a new imaging technique, swept-angle synthetic wavelength interferometry, for full-field micron-scale 3D sensing. As in conventional synthetic wavelength interferometry, our technique uses light consisting of two narrowly-separated optical wavelengths, resulting in per-pixel interferometric measurements whose phase encodes scene depth. Our technique additionally uses a new type of light source that, by emulating spatially-incoherent illumination, makes interferometric measurements insensitive to aberrations and (sub)surface scattering, effects that corrupt phase measurements. The resulting technique combines the robustness to such corruptions of scanning interferometric setups, with the speed of full-field interferometric setups. Overall, our technique can recover full-frame depth at a lateral and axial resolution of 5 microns, at frame rates of 5 Hz, even under strong ambient light. We build an experimental prototype, and use it to demonstrate these capabilities by scanning a variety of objects, including objects representative of applications in inspection and fabrication, and objects that contain challenging light scattering effects.


title: Experiences with task-based programming using cluster nodes as OpenMP devices

abstract: Programming a distributed system, such as a cluster, requires extended use of low-level communication libraries and can often become cumbersome and error prone for the average developer. In this work, we consider each node of a cluster as a separate OpenMP device, able to run code with OpenMP directives in parallel. We make use of the OpenMP device model to provide an easy and intuitive way to program available cluster nodes. Based on that, we examine modifications that were necessary to make existing task-based applications able to exploit such an infrastructure. Finally, we evaluate the performance of the system and conclude that one can gain significant speedup, as long as the application tasks do not produce excessive communication overheads.


title: Multiplication Groups of Abelian Torsion-Free Groups of Finite Rank

abstract: For an Abelian group $G$, any homomorphism $\mu\colon G\otimes G\rightarrow G$ is called a \textsf{multiplication} on $G$. The set $\text{Mult}\,G$ of all multiplications on an Abelian group $G$ itself is an Abelian group with respect to addition; the group is called the \textsf{multiplication group} of $G$. Let $\mathcal{A}_0$ be the class of all reduced block-rigid almost completely decomposable groups of ring type with cyclic regulator quotient. In this paper, for groups $G\in \mathcal{A}_0$, we describe groups $\text{Mult}\,G$. We prove that for $G\in \mathcal{A}_0$, the group $\text{Mult}\,G$ also belongs to the class $\mathcal{A}_0$. For any group $G\in \mathcal{A}_0$, we describe the rank, the regulator, the regulator index, invariants of near-isomorphism, a main decomposition, and a standard representation of the group $\text{Mult}\,G$.


title: BunchBFT: Across-Cluster Consensus Protocol

abstract: In this paper, we present BunchBFT Byzantine fault-tolerant state-machine replication for high performance and scalability. At the heart of BunchBFT is a novel design called the cluster-based approach that divides the replicas into clusters of replicas. By combining this cluster-based approach with hierarchical communications across clusters, piggybacking techniques for sending messages across clusters, and decentralized leader election for each cluster, BunchBFT achieves high performance and scalability. We also prove that BunchBFT satisfies the basic safety and liveness properties of Byzantine consensus. We implemented a prototype of BunchBFT in our PaxiBFT framework to show that the BunchBFT can improve the MirBFT's throughput by 10x, depending on the available bandwidth on wide-area links.


title: Realization of bifurcations of Liouville foliations for integrable billiards in non-convex domains

abstract: A billiard is a dynamical system in which a particle alternates between motion in a straight line and specular reflection from a boundary. For billiards in non-convex areas bounded by segments of confocal quadrics are studied. The topology of 3-dimmensional bifurcations of Liouville foliations is described.


title: Vision Transformers in 2022: An Update on Tiny ImageNet

abstract: The recent advances in image transformers have shown impressive results and have largely closed the gap between traditional CNN architectures. The standard procedure is to train on large datasets like ImageNet-21k and then finetune on ImageNet-1k. After finetuning, researches will often consider the transfer learning performance on smaller datasets such as CIFAR-10/100 but have left out Tiny ImageNet. This paper offers an update on vision transformers' performance on Tiny ImageNet. I include Vision Transformer (ViT) , Data Efficient Image Transformer (DeiT), Class Attention in Image Transformer (CaiT), and Swin Transformers. In addition, Swin Transformers beats the current state-of-the-art result with a validation accuracy of 91.35%. Code is available here: https://github.com/ehuynh1106/TinyImageNet-Transformers


title: An Empirical Investigation of Commonsense Self-Supervision with Knowledge Graphs

abstract: Self-supervision based on the information extracted from large knowledge graphs has been shown to improve the generalization of language models, in zero-shot evaluation on various downstream language reasoning tasks. Since these improvements are reported in aggregate, however, little is known about (i) how to select the appropriate knowledge for solid performance across tasks, (ii) how to combine this knowledge with neural language models, and (iii) how these pairings affect granular task performance. In this paper, we study the effect of knowledge sampling strategies and sizes that can be used to generate synthetic data for adapting language models. We study the effect of different synthetic datasets on language models with various architectures and sizes. The resulting models are evaluated against four task properties: domain overlap, answer similarity, vocabulary overlap, and answer length. Our experiments show that encoder-decoder models benefit from more data to learn from, whereas sampling strategies that balance across different aspects yield best performance. Most of the improvement occurs on questions with short answers and dissimilar answer candidates, which corresponds to the characteristics of the data used for pre-training.


title: Equivariant Mesh Attention Networks

abstract: Equivariance to symmetries has proven to be a powerful inductive bias in deep learning research. Recent works on mesh processing have concentrated on various kinds of natural symmetries, including translations, rotations, scaling, node permutations, and gauge transformations. To date, no existing architecture is equivariant to all of these transformations. In this paper, we present an attention-based architecture for mesh data that is provably equivariant to all transformations mentioned above. Our pipeline relies on the use of relative tangential features: a simple, effective, equivariance-friendly alternative to raw node positions as inputs. Experiments on the FAUST and TOSCA datasets confirm that our proposed architecture achieves improved performance on these benchmarks and is indeed equivariant, and therefore robust, to a wide variety of local/global transformations.


title: Transformer based Generative Adversarial Network for Liver Segmentation

abstract: Automated liver segmentation from radiology scans (CT, MRI) can improve surgery and therapy planning and follow-up assessment in addition to conventional use for diagnosis and prognosis. Although convolutional neural networks (CNNs) have become the standard image segmentation tasks, more recently this has started to change towards Transformers based architectures because Transformers are taking advantage of capturing long range dependence modeling capability in signals, so called attention mechanism. In this study, we propose a new segmentation approach using a hybrid approach combining the Transformer(s) with the Generative Adversarial Network (GAN) approach. The premise behind this choice is that the self-attention mechanism of the Transformers allows the network to aggregate the high dimensional feature and provide global information modeling. This mechanism provides better segmentation performance compared with traditional methods. Furthermore, we encode this generator into the GAN based architecture so that the discriminator network in the GAN can classify the credibility of the generated segmentation masks compared with the real masks coming from human (expert) annotations. This allows us to extract the high dimensional topology information in the mask for biomedical image segmentation and provide more reliable segmentation results. Our model achieved a high dice coefficient of 0.9433, recall of 0.9515, and precision of 0.9376 and outperformed other Transformer based approaches.


title: Temporal Domain Generalization with Drift-Aware Dynamic Neural Networks

abstract: Temporal domain generalization is a promising yet extremely challenging area where the goal is to learn models under temporally changing data distributions and generalize to unseen data distributions following the trends of the change. The advancement of this area is challenged by: 1) characterizing data distribution drift and its impacts on models, 2) expressiveness in tracking the model dynamics, and 3) theoretical guarantee on the performance. To address them, we propose a Temporal Domain Generalization with Drift-Aware Dynamic Neural Network (DRAIN) framework. Specifically, we formulate the problem into a Bayesian framework that jointly models the relation between data and model dynamics. We then build a recurrent graph generation scenario to characterize the dynamic graph-structured neural networks learned across different time points. It captures the temporal drift of model parameters and data distributions and can predict models in the future without the presence of future data. In addition, we explore theoretical guarantees of the model performance under the challenging temporal DG setting and provide theoretical analysis, including uncertainty and generalization error. Finally, extensive experiments on several real-world benchmarks with temporal drift demonstrate the effectiveness and efficiency of the proposed method.


title: European Power Option Pricing with Extended Vasic\v{e}k Interest Rate and Exponential Ornstein-Uhlenbeck Asset Process under Different Market Assumptions

abstract: We propose a general framework of European power option pricing under two different market assumptions about extended Vasic\v{e}k interest rate process and exponential Ornstein-Uhlenbeck asset process with continuous dividend as underlying, in which the Brownian motions involved in Vasic\v{e}k interest rate and exponential Ornstein-Uhlenbeck process are time-dependent correlated in equivalent martingale measure probability space or real-world probability space respectively. We first develop European power option pricing in two types of payoffs with martingale method under the market assumption that Vasic\v{e}k interest rate and exponential Ornstein-Uhlenbeck process are correlated in equivalent martingale measure probability space. Then, we solve the European power option pricing under the market assumption that Vasic\v{e}k interest rate and exponential Ornstein-Uhlenbeck process are correlated in real-world probability by constructing a Girsannov transform to map real-world probability to risk-neutral equivalent martingale measure. Finally, the European power option pricing formulae are derived with numeraire change and T-forward measure under the above two market assumptions in a uniform theoretical framework and close formulae expression.


title: MultiBiSage: A Web-Scale Recommendation System Using Multiple Bipartite Graphs at Pinterest

abstract: Graph Convolutional Networks (GCN) can efficiently integrate graph structure and node features to learn high-quality node embeddings. These embeddings can then be used for several tasks such as recommendation and search. At Pinterest, we have developed and deployed PinSage, a data-efficient GCN that learns pin embeddings from the Pin-Board graph. The Pin-Board graph contains pin and board entities and the graph captures the pin belongs to a board interaction. However, there exist several entities at Pinterest such as users, idea pins, creators, and there exist heterogeneous interactions among these entities such as add-to-cart, follow, long-click. In this work, we show that training deep learning models on graphs that captures these diverse interactions would result in learning higher-quality pin embeddings than training PinSage on only the Pin-Board graph. To that end, we model the diverse entities and their diverse interactions through multiple bipartite graphs and propose a novel data-efficient MultiBiSage model. MultiBiSage can capture the graph structure of multiple bipartite graphs to learn high-quality pin embeddings. We take this pragmatic approach as it allows us to utilize the existing infrastructure developed at Pinterest -- such as Pixie system that can perform optimized random-walks on billion node graphs, along with existing training and deployment workflows. We train MultiBiSage on six bipartite graphs including our Pin-Board graph. Our offline metrics show that MultiBiSage significantly outperforms the deployed latest version of PinSage on multiple user engagement metrics.


title: Individual Topology Structure of Eye Movement Trajectories

abstract: Traditionally, extracting patterns from eye movement data relies on statistics of different macro-events such as fixations and saccades. This requires an additional preprocessing step to separate the eye movement subtypes, often with a number of parameters on which the classification results depend. Besides that, definitions of such macro events are formulated in different ways by different researchers. We propose an application of a new class of features to the quantitative analysis of personal eye movement trajectories structure. This new class of features based on algebraic topology allows extracting patterns from different modalities of gaze such as time series of coordinates and amplitudes, heatmaps, and point clouds in a unified way at all scales from micro to macro. We experimentally demonstrate the competitiveness of the new class of features with the traditional ones and their significant synergy while being used together for the person authentication task on the recently published eye movement trajectories dataset.


title: Supplementary Results of a Comparative Syntactic and Semantic Study of Terms for Software Testing Glossaries

abstract: This preprint specifies supplementary material and the results of a comparative, syntactic, and semantic study of terms for three software testing glossaries. The three software testing glossaries are: the ISO 29119-1, Concepts and definitions standard, the Standard Glossary of Terms used in Software Testing (version 3.5) by the International Software Testing Qualifications Board (ISTQB), and the glossary provided by the Test Maturity Model integration (TMMi) Foundation. First, we categorized the glossaries terms by analyzing their given semantics into 8 categories, namely: test project, strategy, or organization; testing process or activity; test goal, requirement, or entity; test work product; testing method or technique; testing agent, role, or tool; other terms somewhat related to test; and terms beyond the testing domain. Also, we designed a set of metrics that serve to extract and produce data that support the analysis of syntactic and semantic similarities and discrepancies, and ultimately the analysis of consistencies and inconsistencies between glossaries' terms. It is important to remark that in this work the whole analysis is focused on glossaries terms whose names end with the word "testing".


title: Identification and Properties of Isolated Field Elliptical Galaxies from CFHTLS-W1

abstract: We present a catalogue of isolated field elliptical (IfE) galaxies drawn from the W1 field of the Canada-France-Hawaii Telescope Legacy Survey (CFHTLS). 228 IfEs were identified from a flux-limited (r<21.8) galaxy catalogue which corresponds to a density of 3 IfE/sq.deg. For comparison we consider a sample of elliptical galaxies living in dense environments, based on identification of the brightest cluster galaxies (BGCs) in the same survey. Using the same dataset for the comparison sample ensures a uniform selection, including in the redshift range as IfEs (i.e. 0.1 < z < 0.9). A comparison of elliptical galaxies in different environments reveals that IfEs and BCGs have similar behaviours in their colours, star formation activities, and scaling relations of mass-size and size-luminosity. IfEs and BCGs have similar slopes in the scaling relations with respect to cluster ellipticals within the $-24 \leq M_{r} \leq -22$ magnitude and $10.2< \textrm{log}( \textrm M_{*}/ \textrm M_\odot)\leq12.0$ mass ranges. Three IfEs identified in this study can be associated with fossil groups found in the same survey area which gives clues for future studies.


title: Online Coreference Resolution for Dialogue Processing: Improving Mention-Linking on Real-Time Conversations

abstract: This paper suggests a direction of coreference resolution for online decoding on actively generated input such as dialogue, where the model accepts an utterance and its past context, then finds mentions in the current utterance as well as their referents, upon each dialogue turn. A baseline and four incremental-updated models adapted from the mention-linking paradigm are proposed for this new setting, which address different aspects including the singletons, speaker-grounded encoding and cross-turn mention contextualization. Our approach is assessed on three datasets: Friends, OntoNotes, and BOLT. Results show that each aspect brings out steady improvement, and our best models outperform the baseline by over 10%, presenting an effective system for this setting. Further analysis highlights the task characteristics, such as the significance of addressing the mention recall.


title: Pessimism for Offline Linear Contextual Bandits using $\ell_p$ Confidence Sets

abstract: We present a family $\{\hat{\pi}\}_{p\ge 1}$ of pessimistic learning rules for offline learning of linear contextual bandits, relying on confidence sets with respect to different $\ell_p$ norms, where $\hat{\pi}_2$ corresponds to Bellman-consistent pessimism (BCP), while $\hat{\pi}_\infty$ is a novel generalization of lower confidence bound (LCB) to the linear setting. We show that the novel $\hat{\pi}_\infty$ learning rule is, in a sense, adaptively optimal, as it achieves the minimax performance (up to log factors) against all $\ell_q$-constrained problems, and as such it strictly dominates all other predictors in the family, including $\hat{\pi}_2$.


title: Multi-task Learning for Gaussian Graphical Regressions with High Dimensional Covariates

abstract: Gaussian graphical regression is a powerful means that regresses the precision matrix of a Gaussian graphical model on covariates, permitting the numbers of the response variables and covariates to far exceed the sample size. Model fitting is typically carried out via separate node-wise lasso regressions, ignoring the network-induced structure among these regressions. Consequently, the error rate is high, especially when the number of nodes is large. We propose a multi-task learning estimator for fitting Gaussian graphical regression models; we design a cross-task group sparsity penalty and a within task element-wise sparsity penalty, which govern the sparsity of active covariates and their effects on the graph, respectively. For computation, we consider an efficient augmented Lagrangian algorithm, which solves subproblems with a semi-smooth Newton method. For theory, we show that the error rate of the multi-task learning based estimates has much improvement over that of the separate node-wise lasso estimates, because the cross-task penalty borrows information across tasks. To address the main challenge that the tasks are entangled in a complicated correlation structure, we establish a new tail probability bound for correlated heavy-tailed (sub-exponential) variables with an arbitrary correlation structure, a useful theoretical result in its own right. Finally, the utility of our method is demonstrated through simulations as well as an application to a gene co-expression network study with brain cancer patients.


title: A Safety-Prioritized Receding Horizon Control Framework for Platoon Formation in a Mixed Traffic Environment

abstract: Platoon formation with connected and automated vehicles (CAVs) in a mixed traffic environment poses significant challenges due to the presence of human-driven vehicles (HDVs) with unknown dynamics and control actions. In this paper, we develop a safety-prioritized receding horizon control framework for creating platoons of HDVs preceded by a CAV. Our framework ensures indirect control of the following HDVs by directly controlling the leading CAV given the safety constraints. The framework utilizes a data-driven prediction model that is based on the recursive least squares algorithm and the constant time headway relative velocity car-following model to predict future trajectories of human-driven vehicles. To demonstrate the efficacy of the proposed framework, we conduct numerical simulations and provide the associated scalability, robustness, and performance analyses.


title: NS3: Neuro-Symbolic Semantic Code Search

abstract: Semantic code search is the task of retrieving a code snippet given a textual description of its functionality. Recent work has been focused on using similarity metrics between neural embeddings of text and code. However, current language models are known to struggle with longer, compositional text, and multi-step reasoning. To overcome this limitation, we propose supplementing the query sentence with a layout of its semantic structure. The semantic layout is used to break down the final reasoning decision into a series of lower-level decisions. We use a Neural Module Network architecture to implement this idea. We compare our model - NS3 (Neuro-Symbolic Semantic Search) - to a number of baselines, including state-of-the-art semantic code retrieval methods, and evaluate on two datasets - CodeSearchNet and Code Search and Question Answering. We demonstrate that our approach results in more precise code retrieval, and we study the effectiveness of our modular design when handling compositional queries.


title: Two-photon absorption measurements in the presence of single-photon losses

abstract: We discuss how two-photon absorption (TPA) of squeezed and coherent states of light can be detected in measurements of the transmitted light fields. Such measurements typically suffer from competing loss mechanisms such as experimental imperfections and linear scattering losses inside the sample itself, which can lead to incorrect assessments of the two-photon absorption cross section. We evaluate the sensitivity with which TPA can be detected and find that TPA sensitivity of squeezed vacua or squeezed coherent states can become independent of linear losses at sufficiently large photon numbers. In particular, this happens for measurements of the photon number or of the anti-squeezed field quadrature, where large fluctuations counteract and exactly cancel the degradation caused by single photon losses.


title: Terraform -- Automating Infrastructure as a Service

abstract: Developing a software service requires a strict software development life cycle and process. This process demands controlling all application code through source control management as well as a rigorous versioning and branching strategy. However, the platform and infrastructure also benefit from this rigor. Software services must be deployed to a target run time environment and provisioning that environment through manual user actions is tedious and error-prone. Provisioning manually also becomes prohibitive as the number of resources grow and spread globally over multiple regions. The answer is to apply the same rigor to provisioning the infrastructure as applied to developing the application software. Terraform provides a platform allowing infrastructure resources to be defined in code. This code not only allows the automation of the infrastructure provisioning but also allows for a strict development and review life cycle, same as the application software.


title: Risk-Driven Design of Perception Systems

abstract: Modern autonomous systems rely on perception modules to process complex sensor measurements into state estimates. These estimates are then passed to a controller, which uses them to make safety-critical decisions. It is therefore important that we design perception systems to minimize errors that reduce the overall safety of the system. We develop a risk-driven approach to designing perception systems that accounts for the effect of perceptual errors on the performance of the fully-integrated, closed-loop system. We formulate a risk function to quantify the effect of a given perceptual error on overall safety, and show how we can use it to design safer perception systems by including a risk-dependent term in the loss function and generating training data in risk-sensitive regions. We evaluate our techniques on a realistic vision-based aircraft detect and avoid application and show that risk-driven design reduces collision risk by 37% over a baseline system.


title: On the problem of entity matching and its application in automated settlement of receivables

abstract: This paper covers automated settlement of receivables in non-governmental organizations. We tackle the problem with entity matching techniques. We consider setup, where base algorithm is used for preliminary ranking of matches, then we apply several novel methods to increase matching quality of base algorithm: score post processing, cascade model and chain model. The methods presented here contribute to automated settlement of receivables, entity matching and multilabel classification in open-world scenario. We evaluate our approach on real world operational data which come from company providing settlement of receivables as a service: proposed methods boost recall from 78% (base model) to >90% at precision 99%.


title: What do you need to consider when designing mobile health intervention?

abstract: Designing theory-driven digital health interventions is a challenging task that needs support. We created a guide for the incomers in the field on how to design digital health interventions with case studies from the Cancer Better Life Experience (CAPABLE) European project. The guide explains how behaviour change theories can inform customisation and personalisation of the intervention. The proposed SATO (ideaS expAnded wiTh bciO) design workflow is based on the IDEAS (Integrate, Design, Assess, and Share) framework and is aligned with the Behaviour Change Intervention Ontology (BCIO). We provide a checklist of the activities that should be performed during intervention planning as well as app design templates which bundle together relevant behaviour change techniques. In the process of creating this guide, we found the necessity to extend the BCIO to support the scenarios of multiple clinical goals in the same application. The extension utilizes existing classes and properties where possible.


title: A simple solution to the problem of self-assembling cubic diamond crystals

abstract: The self-assembly of colloidal diamond (CD) crystals is considered as one of the most coveted goals of nanotechnology, both from the technological and fundamental points of view. For applications, colloidal diamond is a photonic crystal which can open new possibilities of manipulating light for information processing. From a fundamental point of view, its unique symmetry exacerbates a series of problems that are commonly faced during the self-assembly of target structures, such as the presence of kinetic traps and the formation of crystalline defects and alternative structures (polymorphs). Here we demonstrate that all these problems can be systematically addressed via SAT-assembly, a design framework that converts self-assembly into a satisfiability problem. Contrary to previous solutions (requiring four or more components), we prove that the assembly of the CD crystal only requires a binary mixture. Moreover, we use molecular dynamics simulations of a system composed by nearly a million nucleotides to test a DNA nanotechnology design that constitutes a promising candidate for experimental realization.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.comp-ph


title: Nonparametric Decentralized Detection and Sparse Sensor Selection via Multi-Sensor Online Kernel Scalar Quantization

abstract: Signal classification problems arise in a wide variety of applications, and their demand is only expected to grow. In this paper, we focus on the wireless sensor network signal classification setting, where each sensor forwards quantized signals to a fusion center to be classified. Our primary goal is to train a decision function and quantizers across the sensors to maximize the classification performance in an online manner. Moreover, we are interested in sparse sensor selection using a marginalized weighted kernel approach to improve network resource efficiency by disabling less reliable sensors with minimal effect on classification performance.To achieve our goals, we develop a multi-sensor online kernel scalar quantization (MSOKSQ) learning strategy that operates on the sensor outputs at the fusion center. Our theoretical analysis reveals how the proposed algorithm affects the quantizers across the sensors. Additionally, we provide a convergence analysis of our online learning approach by studying its relationship to batch learning. We conduct numerical studies under different classification and sensor network settings which demonstrate the accuracy gains from optimizing different components of MSOKSQ and robustness to reduction in the number of sensors selected.


title: A Novel Markov Model for Near-Term Railway Delay Prediction

abstract: Predicting the near-future delay with accuracy for trains is momentous for railway operations and passengers' traveling experience. This work aims to design prediction models for train delays based on Netherlands Railway data. We first develop a chi-square test to show that the delay evolution over stations follows a first-order Markov chain. We then propose a delay prediction model based on non-homogeneous Markov chains. To deal with the sparsity of the transition matrices of the Markov chains, we propose a novel matrix recovery approach that relies on Gaussian kernel density estimation. Our numerical tests show that this recovery approach outperforms other heuristic approaches in prediction accuracy. The Markov chain model we propose also shows to be better than other widely-used time series models with respect to both interpretability and prediction accuracy. Moreover, our proposed model does not require a complicated training process, which is capable of handling large-scale forecasting problems.


title: Scalable and Efficient Training of Large Convolutional Neural Networks with Differential Privacy

abstract: Large convolutional neural networks (CNN) can be difficult to train in the differentially private (DP) regime, since the optimization algorithms require a computationally expensive operation, known as the per-sample gradient clipping. We propose an efficient and scalable implementation of this clipping on convolutional layers, termed as the mixed ghost clipping, that significantly eases the private training in terms of both time and space complexities, without affecting the accuracy. The improvement in efficiency is rigorously studied through the first complexity analysis for the mixed ghost clipping and existing DP training algorithms. Extensive experiments on vision classification tasks, with large ResNet, VGG, and Vision Transformers, demonstrate that DP training with mixed ghost clipping adds $1\sim 10\%$ memory overhead and $<2\times$ slowdown to the standard non-private training. Specifically, when training VGG19 on CIFAR10, the mixed ghost clipping is $3\times$ faster than state-of-the-art Opacus library with $18\times$ larger maximum batch size. To emphasize the significance of efficient DP training on convolutional layers, we achieve 96.7\% accuracy on CIFAR10 and 83.0\% on CIFAR100 at $\epsilon=1$ using BEiT, while the previous best results are 94.8\% and 67.4\%, respectively. We open-source a privacy engine (\url{https://github.com/woodyx218/private_vision}) that implements DP training of CNN with a few lines of code.


title: Interpreting Neural Min-Sum Decoders

abstract: In decoding linear block codes, it was shown that noticeable reliability gains can be achieved by introducing learnable parameters to the Belief Propagation (BP) decoder. Despite the success of these methods, there are two key open problems. The first is the lack of interpretation of the learned weights, and the other is the lack of analysis for non-AWGN channels. In this work, we aim to bridge this gap by providing insights into the weights learned and their connection to the structure of the underlying code. We show that the weights are heavily influenced by the distribution of short cycles in the code. We next look at the performance of these decoders in non-AWGN channels, both synthetic and over-the-air channels, and study the complexity vs. performance trade-offs, demonstrating that increasing the number of parameters helps significantly in complex channels. Finally, we show that the decoders with learned weights achieve higher reliability than those with weights optimized analytically under the Gaussian approximation.


abstract: The grammars used in grammar-based Genetic Programming (GP) methods have a significant impact on the quality of the solutions generated since they define the search space by restricting the solutions to its syntax. In this work, we propose Probabilistic Structured Grammatical Evolution (PSGE), a new approach that combines the Structured Grammatical Evolution (SGE) and Probabilistic Grammatical Evolution (PGE) representation variants and mapping mechanisms. The genotype is a set of dynamic lists, one for each non-terminal in the grammar, with each element of the list representing a probability used to select the next Probabilistic Context-Free Grammar (PCFG) derivation rule. PSGE statistically outperformed Grammatical Evolution (GE) on all six benchmark problems studied. In comparison to PGE, PSGE outperformed 4 of the 6 problems analyzed.


title: Post-breach Recovery: Protection against White-box Adversarial Examples for Leaked DNN Models

abstract: Server breaches are an unfortunate reality on today's Internet. In the context of deep neural network (DNN) models, they are particularly harmful, because a leaked model gives an attacker "white-box" access to generate adversarial examples, a threat model that has no practical robust defenses. For practitioners who have invested years and millions into proprietary DNNs, e.g. medical imaging, this seems like an inevitable disaster looming on the horizon. In this paper, we consider the problem of post-breach recovery for DNN models. We propose Neo, a new system that creates new versions of leaked models, alongside an inference time filter that detects and removes adversarial examples generated on previously leaked models. The classification surfaces of different model versions are slightly offset (by introducing hidden distributions), and Neo detects the overfitting of attacks to the leaked model used in its generation. We show that across a variety of tasks and attack methods, Neo is able to filter out attacks from leaked models with very high accuracy, and provides strong protection (7--10 recoveries) against attackers who repeatedly breach the server. Neo performs well against a variety of strong adaptive attacks, dropping slightly in # of breaches recoverable, and demonstrates potential as a complement to DNN defenses in the wild.


title: Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding

abstract: There is a growing body of work in recent years to develop pre-trained language models (PLMs) for the Arabic language. This work concerns addressing two major problems in existing Arabic PLMs which constraint progress of the Arabic NLU and NLG fields.First, existing Arabic PLMs are not well-explored and their pre-trainig can be improved significantly using a more methodical approach. Second, there is a lack of systematic and reproducible evaluation of these models in the literature. In this work, we revisit both the pre-training and evaluation of Arabic PLMs. In terms of pre-training, we explore improving Arabic LMs from three perspectives: quality of the pre-training data, size of the model, and incorporating character-level information. As a result, we release three new Arabic BERT-style models ( JABER, Char-JABER, and SABER), and two T5-style models (AT5S and AT5B). In terms of evaluation, we conduct a comprehensive empirical study to systematically evaluate the performance of existing state-of-the-art models on ALUE that is a leaderboard-powered benchmark for Arabic NLU tasks, and on a subset of the ARGEN benchmark for Arabic NLG tasks. We show that our models significantly outperform existing Arabic PLMs and achieve a new state-of-the-art performance on discriminative and generative Arabic NLU and NLG tasks. Our models and source code to reproduce of results will be made available shortly.


title: Co-design of Embodied Neural Intelligence via Constrained Evolution

abstract: We introduce a novel co-design method for autonomous moving agents' shape attributes and locomotion by combining deep reinforcement learning and evolution with user control. Our main inspiration comes from evolution, which has led to wide variability and adaptation in Nature and has the potential to significantly improve design and behavior simultaneously. Our method takes an input agent with optional simple constraints such as leg parts that should not evolve or allowed ranges of changes. It uses physics-based simulation to determine its locomotion and finds a behavior policy for the input design, later used as a baseline for comparison. The agent is then randomly modified within the allowed ranges creating a new generation of several hundred agents. The generation is trained by transferring the previous policy, which significantly speeds up the training. The best-performing agents are selected, and a new generation is formed using their crossover and mutations. The next generations are then trained until satisfactory results are reached. We show a wide variety of evolved agents, and our results show that even with only 10% of changes, the overall performance of the evolved agents improves 50%. If more significant changes to the initial design are allowed, our experiments' performance improves even more to 150%. Contrary to related work, our co-design works on a single GPU and provides satisfactory results by training thousands of agents within one hour.


title: Diversity Preference-Aware Link Recommendation for Online Social Networks

abstract: Link recommendation, which recommends links to connect unlinked online social network users, is a fundamental social network analytics problem with ample business implications. Existing link recommendation methods tend to recommend similar friends to a user but overlook the user's diversity preference, although social psychology theories suggest the criticality of diversity preference to link recommendation performance. In recommender systems, a field related to link recommendation, a number of diversification methods have been proposed to improve the diversity of recommended items. Nevertheless, diversity preference is distinct from diversity studied by diversification methods. To address these research gaps, we define and operationalize the concept of diversity preference for link recommendation and propose a new link recommendation problem: the diversity preference-aware link recommendation problem. We then analyze key properties of the new link recommendation problem and develop a novel link recommendation method to solve the problem. Using two large-scale online social network data sets, we conduct extensive empirical evaluations to demonstrate the superior performance of our method over representative diversification methods adapted for link recommendation as well as state-of-the-art link recommendation methods.


title: The Interferometric Binary Epsilon Cancri in Praesepe: Precise Masses and Age

abstract: We observe the brightest member of the Praesepe cluster, Epsilon Cancri, to precisely measure the characteristics of the stars in this binary system, en route to a new measurement of the cluster's age. We present spectroscopic radial velocity measurements and interferometric observations of the sky-projected orbit to derive the masses, which we find to be M_1/M_sun = 2.420 +/- 0.008 and M_2/M_sun = 2.226 +/- 0.004. We place limits on the color-magnitude positions of the stars by using spectroscopic and interferometric luminosity ratios while trying to reproduce the spectral energy distribution of Epsilon Cancri. We re-examine the cluster membership of stars at the bright end of the color-magnitude diagram using Gaia data and literature radial velocity information. The binary star data are consistent with an age of 637 +/- 19 Myr, as determined from MIST model isochrones. The masses and luminosities of the stars appear to select models with the most commonly used amount of convective core overshooting.


title: Producing Histopathology Phantom Images using Generative Adversarial Networks to improve Tumor Detection

abstract: Advance in medical imaging is an important part in deep learning research. One of the goals of computer vision is development of a holistic, comprehensive model which can identify tumors from histology slides obtained via biopsies. A major problem that stands in the way is lack of data for a few cancer-types. In this paper, we ascertain that data augmentation using GANs can be a viable solution to reduce the unevenness in the distribution of different cancer types in our dataset. Our demonstration showed that a dataset augmented to a 50% increase causes an increase in tumor detection from 80% to 87.5%


title: All You Need Is Logs: Improving Code Completion by Learning from Anonymous IDE Usage Logs

abstract: In this work, we propose an approach for collecting completion usage logs from the users in an IDE and using them to train a machine learning based model for ranking completion candidates. We developed a set of features that describe completion candidates and their context, and deployed their anonymized collection in the Early Access Program of IntelliJ-based IDEs. We used the logs to collect a dataset of code completions from users, and employed it to train a ranking CatBoost model. Then, we evaluated it in two settings: on a held-out set of the collected completions and in a separate A/B test on two different groups of users in the IDE. Our evaluation shows that using a simple ranking model trained on the past user behavior logs significantly improved code completion experience. Compared to the default heuristics-based ranking, our model demonstrated a decrease in the number of typing actions necessary to perform the completion in the IDE from 2.073 to 1.832. The approach adheres to privacy requirements and legal constraints, since it does not require collecting personal information, performing all the necessary anonymization on the client's side. Importantly, it can be improved continuously: implementing new features, collecting new data, and evaluating new models - this way, we have been using it in production since the end of 2020.


title: A continuum framework for phase field with bulk-surface dynamics

abstract: This continuum mechanical theory aims at detailing the underlying rational mechanics of dynamic boundary conditions proposed by Fischer, Maass, & Dieterich [1], Goldstein, Miranville, & Schimperna [2], and Knopf, Lam, Liu & Metzger, [3]. As a byproduct, we generalize these theories. These types of dynamic boundary conditions are described by the coupling between the bulk and surface partial differential equations for phase fields. Our point of departure within this continuum framework is the principle of virtual powers postulated on an arbitrary part $\mathcal{P}$ where the boundary $\partial\mathcal{P}$ may lose smoothness. That is, the normal field may be discontinuous along an edge $\partial^2\mathcal{P}$. However, the edges characterizing the discontinuity of the normal field are considered smooth. Our results may be summarized as follows. We provide a generalized version of the principle of virtual powers for the bulk-surface coupling along with a generalized version of the partwise free-energy imbalance. Next, we derive the explicit form of the surface and edge microtractions along with the field equations for the bulk and surface phase fields. The final set of field equations somewhat resembles the Cahn--Hilliard equation for both the bulk and surface. Lastly, we provide a suitable set of constitutive relations and thermodynamically consistent boundary conditions.


title: Annihilators in the bidual of generalized group algebra of a discrete group

abstract: In this short note, the second dual of generalized group algebra $(\ell^1(G,\mathcal A),\ast)$ equipped with both Arens products is investigated, where $G$ is any discrete group and $\mathcal A$ is a Banach algebra containing a complemented algebraic copy of $(\ell^1(\mathbb N),\bullet)$. We give an explicit family of annihilators(w.r.t both the Arens product) in the algebra $\ell^1(G,\mathcal A)^{**}$, arising from non-principal ultrafilters on $\mathbb N$ and which are not in the topological center. As a consequence, we also deduce the fact that $\ell^1(G,\mathcal A)$ is not Strongly Arens irregular.


title: Evaluation of User Perception on Biometric Fingerprint System

abstract: Biometric systems involve security assurance to make our system highly secured and robust. Nowadays, biometric technology has been fixed into new systems with the aim of enforcing strong privacy and security. Several innovative system have been introduced, and most of them have biometrics installed to protect military bases, banking machines, and other sophisticated systems, such as online tracking systems. Businesses can now focus on their core functions and feel confident about their data security. Despite the benefits and enhancements in security that biometrics offer, there are also some vulnerabilities. This study aimed to investigate the biometric vulnerabilities in a healthcare facility and propose possible countermeasures for biometric system vulnerabilities.


title: Life after BERT: What do Other Muppets Understand about Language?

abstract: Existing pre-trained transformer analysis works usually focus only on one or two model families at a time, overlooking the variability of the architecture and pre-training objectives. In our work, we utilize the oLMpics benchmark and psycholinguistic probing datasets for a diverse set of 29 models including T5, BART, and ALBERT. Additionally, we adapt the oLMpics zero-shot setup for autoregressive models and evaluate GPT networks of different sizes. Our findings show that none of these models can resolve compositional questions in a zero-shot fashion, suggesting that this skill is not learnable using existing pre-training objectives. Furthermore, we find that global model decisions such as architecture, directionality, size of the dataset, and pre-training objective are not predictive of a model's linguistic capabilities.


title: Lassoed Tree Boosting

abstract: Gradient boosting performs exceptionally in most prediction problems and scales well to large datasets. In this paper we prove that a ``lassoed'' gradient boosted tree algorithm with early stopping achieves faster than $n^{-1/4}$ L2 convergence in the large nonparametric space of cadlag functions of bounded sectional variation. This rate is remarkable because it does not depend on the dimension, sparsity, or smoothness. We use simulation and real data to confirm our theory and demonstrate empirical performance and scalability on par with standard boosting. Our convergence proofs are based on a novel, general theorem on early stopping with empirical loss minimizers of nested Donsker classes.


title: Images of multilinear graded polynomials on upper triangular matrix algebras

abstract: In this paper we study the images of multilinear graded polynomials on the graded algebra of upper triangular matrices UT_n. For positive integers q \leq n, we classify these images on UT_n endowed with a particular elementary Z_q-grading. As a consequence, we obtain the images of multilinear graded polynomials on UT_n with the natural Z_n-grading. We apply this classification in order to give a new condition for a multilinear polynomial in terms of graded identities so that to obtain the traceless matrices in its image on the full matrix algebra. We also describe the images of multilinear polynomials on the graded algebras UT_2 and UT_3, for arbitrary gradings. We finish the paper by proving a similar result for the graded Jordan algebra UJ_2, and also for UJ_3 endowed with the natural elementary Z_3-grading.


title: Computational needs of quantum mechanical calculations of materials for high-energy physics

abstract: Searches for new physics in high-energy physics (HEP) experiments commonly rely on interactions with materials. A burgeoning direction is the accurate calculation and design of materials for HEP applications. In this Snowmass contribution, I briefly motivate the science need for quantum mechanical calculations of materials for HEP and outline the range of questions that such calculations can address. With this information, I assess the computational needs for ab initio calculations in HEP, the specific computational resources and workflows used by state-of-the-art methods, and finally identify promising future directions such as the use of machine learning and strongly-correlated quantum mechanical calculations moving towards materials calculations on quantum computers.


title: On invariant von Neumann subalgebras rigidity property

abstract: We say that a countable discrete group $\Gamma$ satisfies the invariant von Neumann subalgebras rigidity (ISR) property if every $\Gamma$- invariant von Neumann subalgebra $\mathcal{M}$ in $L(\Gamma)$ is of the form $L(\Lambda)$ for some normal subgroup $\Lambda\lhd \Gamma$. We show many ``negatively curved" groups, including all torsion free non-amenable hyperbolic groups and torsion free groups with positive first $L^2$-Betti number under a mild assumption, and certain finite direct product of them have this property. We also discuss whether the torsion-free assumption can be relaxed.


title: Asymptotic linearity of binomial random hypergraphs via cluster expansion under graph-dependence

abstract: Let integer $n \ge 3$ and integer $r = r(n) \ge 3$. Define the binomial random $r$-uniform hypergraph $H_r(n, p)$ to be the $r$-uniform graph on the vertex set $[n]$ such that each $r$-set is an edge independently with probability $p$. A hypergraph is linear if every pair of hyperedges intersects in at most one vertex. We study the probability of linearity of random hypergraphs $H_r(n, p)$ via cluster expansion and give more precise asymptotics of the probability in question, improving the asymptotic probability of linearity obtained by McKay and Tian, in particular, when $r=3$ and $p = o(n^{-7/5})$.


title: An Analytical Range-Angle Dependent Beam Focusing Model for Terahertz Linear Antenna Array

abstract: This paper considers a scenario in which the Terahertz (THz) transmitter equipped with a linear antenna array wishes to focus its beam to a desired spatial region in the array near-field. The goal is to compute the achievable spatial region and determine how the system parameters such as the carrier frequency, the array dimension and the user's location affect its beam focusing performance. First, based on a theorem from analytic geometry, we show that the achievable focusing spatial region constitutes a rotated ellipse, with the x and y coordinates denoting the range and angle, respectively. In this way, the determination of the spatial region is reduced to a problem of deriving the coverage of an ellipse. The achievable coverage is then obtained in closed form, and the construction of carrier frequency offsets that can analytically control the beam focusing performance is provided. Numerical results validate the theoretical findings and demonstrate the performance of the proposed method.


title: Orbital stability and concentration of standing waves to nonlinear Schr\"odinger systems with mass critical exponent

abstract: For a nonlinear Schr\"odinger system with mass critical exponent, we prove the existence and orbital stability of standing-wave solutions obtained as minimizers of the underlying energy functional restricted to a double mass constraint. In addition, we discuss the concentration of a sequence of minimizers as their masses approach to certain critical masses.


title: A mathematical model of reward-mediated learning in drug addiction

abstract: Substances of abuse are known to activate and disrupt neuronal circuits in the brain reward system. We propose a simple and easily interpretable dynamical systems model to describe the neurobiology of drug addiction that incorporates the psychiatric concepts of reward prediction error (RPE), drug-induced incentive salience (IST), and opponent process theory (OPT). Drug-induced dopamine releases activate a biphasic reward response with pleasurable, positive "a-processes" (euphoria, rush) followed by unpleasant, negative "b-processes" (cravings, withdrawal). Neuroadaptive processes triggered by successive intakes enhance the negative component of the reward response, which the user compensates for by increasing drug dose and/or intake frequency. This positive feedback between physiological changes and drug self-administration leads to habituation, tolerance and eventually to full addiction. Our model gives rise to qualitatively different pathways to addiction that can represent a diverse set of user profiles (genetics, age) and drug potencies. We find that users who have, or neuroadaptively develop, a strong b-process response to drug consumption are most at risk for addiction. Finally, we include possible mechanisms to mitigate withdrawal symptoms, such as through the use of methadone or other auxiliary drugs used in detoxification.


title: Exact couples and their spectral sequences

abstract: Given a bigraded exact couple of modules over some ring, we determine the meaning of the $E^{\infty}$-terms of its associated spectral sequence: Let $L^{\ast}$ and $L_{\ast}$ denote the limit and colimit abutting objects of the exact couple, filtered by the kernel and image objects to the associated cone and cocone diagrams. Then the unstable E-infinite extension theorem states how adjacent filtration quotients of the colimit filtration are extended by $E^{\infty}$ objects over corresponding adjacent filtration quotients of the kernel filtration. The stable E-infinity extension theorem is based on the fact that the derivation process of the exact couple admits a transfinite recursion which is beyond the scope of the traditional spectral sequence perspective. The transfinite recursion always stabilizes at some ordinal. The resulting stable $E$-objects are (a) always subobjects of $E^{\infty}$ and (b) extend adjacent filtration quotients of the colimit filtration over corresponding adjacent filtration quotients of the kernel filtration {\em without} the need for lim-1 corrective terms. The E-infinity extension theorems enable conclusions about the filtered limit/colimit abutments even in cases where the spectral sequence is far from converging in any traditional sense. We develop such results in the context of 'comparing' the spectral sequences via the morphism that is induced by a morphism of underlying exact couples. We also contribute to 'reverse comparison' in a spectral sequence; that is using information about the universal abutment(s) of the underlying exact couple to extract information about one or more pages of the spectral sequence. These results overlap with Zeeman's comparison theorems in a generalizing fashion.


title: GL-RG: Global-Local Representation Granularity for Video Captioning

abstract: Video captioning is a challenging task as it needs to accurately transform visual understanding into natural language description. To date, state-of-the-art methods inadequately model global-local representation across video frames for caption generation, leaving plenty of room for improvement. In this work, we approach the video captioning task from a new perspective and propose a GL-RG framework for video captioning, namely a \textbf{G}lobal-\textbf{L}ocal \textbf{R}epresentation \textbf{G}ranularity. Our GL-RG demonstrates three advantages over the prior efforts: 1) we explicitly exploit extensive visual representations from different video ranges to improve linguistic expression; 2) we devise a novel global-local encoder to produce rich semantic vocabulary to obtain a descriptive granularity of video contents across frames; 3) we develop an incremental training strategy which organizes model learning in an incremental fashion to incur an optimal captioning behavior. Experimental results on the challenging MSR-VTT and MSVD datasets show that our DL-RG outperforms recent state-of-the-art methods by a significant margin. Code is available at \url{https://github.com/ylqi/GL-RG}.


title: Benchmarking the Semi-Stochastic CC(P;Q) Approach for Singlet-Triplet Gaps in Biradicals

abstract: We recently proposed a semi-stochastic approach to converging high-level coupled-cluster (CC) energetics, such as those obtained in the CC calculations with singles, doubles, and triples (CCSDT), in which the deterministic CC($P$;$Q$) framework is merged with the stochastic configuration interaction Quantum Monte Carlo propagations [J. E. Deustua, J. Shen, and P. Piecuch, Phys. Rev. Lett. 119, 223003 (2017)]. In this work, we investigate the ability of the semi-stochastic CC($P$;$Q$) methodology to recover the CCSDT energies of the lowest singlet and triplet states and the corresponding singlet-triplet gaps of biradical systems using methylene, ${\rm (HFH)}^{-}$, cyclobutadiene, cyclopentadienyl cation, and trimethylenemethane as examples.


title: An Ising-type formulation of the six-vertex model

abstract: We show that the celebrated six-vertex model of statistical mechanics (along with its multistate generalizations) can be reformulated as an Ising-type model with only a two-spin interaction. Such a reformulation unravels remarkable factorization properties for row to row transfer matrices, allowing one to uniformly derive all functional relations for their eigenvalues and present the coordinate Bethe ansatz for the eigenvectors for all higher spin generalizations of the six-vertex model. The possibility of the Ising-type formulation of these models raises questions about the precedence of the traditional quantum group description of the vertex models. Indeed, the role of a primary integrability condition is now played by the star-triangle relation, which is not entirely natural in the standard quantum group setting, but implies the vertex-type Yang-Baxter equation and commutativity of transfer matrices as simple corollaries. As a mathematical identity the emerging star-triangle relation is equivalent to the Pfaff-Saalschuetz-Jackson summation formula, originally discovered by J.~F.~Pfaff in 1797. Plausibly, all vertex models associated with quantized affine Lie algebras and superalgebras can be reformulated as Ising-type models with only two-spin interactions.

categories: math-ph cond-mat.stat-mech hep-th math.MP


title: Unlimited accumulation by the Shelah's PCF operator

abstract: Modulo the existence of large cardinals, there is a model of set theory in which for some set $B$ of regular cardinals, the sequence $\langle \text{pcf}^\alpha(B): \alpha \in \text{Ord} \rangle$ is strictly increasing. The result answers a question from [7].


title: Phrase-level Textual Adversarial Attack with Label Preservation

abstract: Generating high-quality textual adversarial examples is critical for investigating the pitfalls of natural language processing (NLP) models and further promoting their robustness. Existing attacks are usually realized through word-level or sentence-level perturbations, which either limit the perturbation space or sacrifice fluency and textual quality, both affecting the attack effectiveness. In this paper, we propose Phrase-Level Textual Adversarial aTtack (PLAT) that generates adversarial samples through phrase-level perturbations. PLAT first extracts the vulnerable phrases as attack targets by a syntactic parser, and then perturbs them by a pre-trained blank-infilling model. Such flexible perturbation design substantially expands the search space for more effective attacks without introducing too many modifications, and meanwhile maintaining the textual fluency and grammaticality via contextualized generation using surrounding texts. Moreover, we develop a label-preservation filter leveraging the likelihoods of language models fine-tuned on each class, rather than textual similarity, to rule out those perturbations that potentially alter the original class label for humans. Extensive experiments and human evaluation demonstrate that PLAT has a superior attack effectiveness as well as a better label consistency than strong baselines.


title: Active Source Free Domain Adaptation

abstract: Source free domain adaptation (SFDA) aims to transfer a trained source model to the unlabeled target domain without accessing the source data. However, the SFDA setting faces an effect bottleneck due to the absence of source data and target supervised information, as evidenced by the limited performance gains of newest SFDA methods. In this paper, for the first time, we introduce a more practical scenario called active source free domain adaptation (ASFDA) that permits actively selecting a few target data to be labeled by experts. To achieve that, we first find that those satisfying the properties of neighbor-chaotic, individual-different, and target-like are the best points to select, and we define them as the minimum happy (MH) points. We then propose minimum happy points learning (MHPL) to actively explore and exploit MH points. We design three unique strategies: neighbor ambient uncertainty, neighbor diversity relaxation, and one-shot querying, to explore the MH points. Further, to fully exploit MH points in the learning process, we design a neighbor focal loss that assigns the weighted neighbor purity to the cross-entropy loss of MH points to make the model focus more on them. Extensive experiments verify that MHPL remarkably exceeds the various types of baselines and achieves significant performance gains at a small cost of labeling.