title: VoxelEmbed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learning

abstract: Recent advances in bioimaging have provided scientists a superior high spatial-temporal resolution to observe dynamics of living cells as 3D volumetric videos. Unfortunately, the 3D biomedical video analysis is lagging, impeded by resource insensitive human curation using off-the-shelf 3D analytic tools. Herein, biologists often need to discard a considerable amount of rich 3D spatial information by compromising on 2D analysis via maximum intensity projection. Recently, pixel embedding-based cell instance segmentation and tracking provided a neat and generalizable computing paradigm for understanding cellular dynamics. In this work, we propose a novel spatial-temporal voxel-embedding (VoxelEmbed) based learning method to perform simultaneous cell instance segmenting and tracking on 3D volumetric video sequences. Our contribution is in four-fold: (1) The proposed voxel embedding generalizes the pixel embedding with 3D context information; (2) Present a simple multi-stream learning approach that allows effective spatial-temporal embedding; (3) Accomplished an end-to-end framework for one-stage 3D cell instance segmentation and tracking without heavy parameter tuning; (4) The proposed 3D quantification is memory efficient via a single GPU with 12 GB memory. We evaluate our VoxelEmbed method on four 3D datasets (with different cell types) from the ISBI Cell Tracking Challenge. The proposed VoxelEmbed method achieved consistent superior overall performance (OP) on two densely annotated datasets. The performance is also competitive on two sparsely annotated cohorts with 20.6% and 2% of data-set having segmentation annotations. The results demonstrate that the VoxelEmbed method is a generalizable and memory-efficient solution.


title: SeqNetVLAD vs PointNetVLAD: Image Sequence vs 3D Point Clouds for Day-Night Place Recognition

abstract: Place Recognition is a crucial capability for mobile robot localization and navigation. Image-based or Visual Place Recognition (VPR) is a challenging problem as scene appearance and camera viewpoint can change significantly when places are revisited. Recent VPR methods based on ``sequential representations'' have shown promising results as compared to traditional sequence score aggregation or single image based techniques. In parallel to these endeavors, 3D point clouds based place recognition is also being explored following the advances in deep learning based point cloud processing. However, a key question remains: is an explicit 3D structure based place representation always superior to an implicit ``spatial'' representation based on sequence of RGB images which can inherently learn scene structure. In this extended abstract, we attempt to compare these two types of methods by considering a similar ``metric span'' to represent places. We compare a 3D point cloud based method (PointNetVLAD) with image sequence based methods (SeqNet and others) and showcase that image sequence based techniques approach, and can even surpass, the performance achieved by point cloud based methods for a given metric span. These performance variations can be attributed to differences in data richness of input sensors as well as data accumulation strategies for a mobile robot. While a perfect apple-to-apple comparison may not be feasible for these two different modalities, the presented comparison takes a step in the direction of answering deeper questions regarding spatial representations, relevant to several applications like Autonomous Driving and Augmented/Virtual Reality. Source code available publicly https://github.com/oravus/seqNet.


title: Wallpaper Texture Generation and Style Transfer Based on Multi-label Semantics

abstract: Textures contain a wealth of image information and are widely used in various fields such as computer graphics and computer vision. With the development of machine learning, the texture synthesis and generation have been greatly improved. As a very common element in everyday life, wallpapers contain a wealth of texture information, making it difficult to annotate with a simple single label. Moreover, wallpaper designers spend significant time to create different styles of wallpaper. For this purpose, this paper proposes to describe wallpaper texture images by using multi-label semantics. Based on these labels and generative adversarial networks, we present a framework for perception driven wallpaper texture generation and style transfer. In this framework, a perceptual model is trained to recognize whether the wallpapers produced by the generator network are sufficiently realistic and have the attribute designated by given perceptual description; these multi-label semantic attributes are treated as condition variables to generate wallpaper images. The generated wallpaper images can be converted to those with well-known artist styles using CycleGAN. Finally, using the aesthetic evaluation method, the generated wallpaper images are quantitatively measured. The experimental results demonstrate that the proposed method can generate wallpaper textures conforming to human aesthetics and have artistic characteristics.


title: A Comprehensive Comparison of Pre-training Language Models

abstract: Recently, the development of pre-trained language models has brought natural language processing (NLP) tasks to the new state-of-the-art. In this paper we explore the efficiency of various pre-trained language models. We pre-train a list of transformer-based models with the same amount of text and the same training steps. The experimental results shows that the most improvement upon the origin BERT is adding the RNN-layer to capture more contextual information for short text understanding. But the conclusion is: There are no remarkable improvement for short text understanding for similar BERT structures. Data-centric method[12] can achieve better performance.


title: Sectoral portfolio optimization by judicious selection of financial ratios via PCA

abstract: Embedding value investment in portfolio optimization models has always been a challenge. In this paper, we attempt to incorporate it by employing principal component analysis to filter out dominant financial ratios from each sector and thereafter, use the portfolio optimization model incorporating second-order stochastic dominance criteria to derive an optimal investment. We consider a total of $11$ financial ratios corresponding to each sector representing four categories of ratios, namely liquidity, solvency, profitability, and valuation. PCA is then applied over a period of 10 years to extract dominant ratios from each sector in two ways, one from the component solution and the other from each category on the basis of their communalities. The two-step Sectoral Portfolio Optimization (SPO) model is then utilized to build an optimal portfolio. The strategy formed using the formerly extracted ratios is termed PCA-SPO(A) and the latter PCA-SPO(B). The results obtained from the proposed strategies are compared with those from mean-variance, minimum variance, SPO, and nominal SSD models, with and without financial ratios. The empirical performance of proposed strategies is analyzed in two ways, viz., using a rolling window scheme and using market trend scenarios for S\&P BSE 500 (India) and S\&P 500 (U.S.) markets. We observe that the proposed strategy PCA-SPO(B) outperforms all other models in terms of downside deviation, CVaR, VaR, Sortino, Rachev, and STARR ratios over almost all out-of-sample periods. This highlights the importance of value investment where ratios are carefully selected and embedded quantitatively in portfolio selection process.


title: Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis

abstract: High-resolution satellite imagery has proven useful for a broad range of tasks, including measurement of global human population, local economic livelihoods, and biodiversity, among many others. Unfortunately, high-resolution imagery is both infrequently collected and expensive to purchase, making it hard to efficiently and effectively scale these downstream tasks over both time and space. We propose a new conditional pixel synthesis model that uses abundant, low-cost, low-resolution imagery to generate accurate high-resolution imagery at locations and times in which it is unavailable. We show that our model attains photo-realistic sample quality and outperforms competing baselines on a key downstream task -- object counting -- particularly in geographic locations where conditions on the ground are changing rapidly.


title: Unsupervised Embedding Adaptation via Early-Stage Feature Reconstruction for Few-Shot Classification

abstract: We propose unsupervised embedding adaptation for the downstream few-shot classification task. Based on findings that deep neural networks learn to generalize before memorizing, we develop Early-Stage Feature Reconstruction (ESFR) -- a novel adaptation scheme with feature reconstruction and dimensionality-driven early stopping that finds generalizable features. Incorporating ESFR consistently improves the performance of baseline methods on all standard settings, including the recently proposed transductive method. ESFR used in conjunction with the transductive method further achieves state-of-the-art performance on mini-ImageNet, tiered-ImageNet, and CUB; especially with 1.2%~2.0% improvements in accuracy over the previous best performing method on 1-shot setting.


title: Routine Clustering of Mobile Sensor Data Facilitates Psychotic Relapse Prediction in Schizophrenia Patients

abstract: We aim to develop clustering models to obtain behavioral representations from continuous multimodal mobile sensing data towards relapse prediction tasks. The identified clusters could represent different routine behavioral trends related to daily living of patients as well as atypical behavioral trends associated with impending relapse. We used the mobile sensing data obtained in the CrossCheck project for our analysis. Continuous data from six different mobile sensing-based modalities (e.g. ambient light, sound/conversation, acceleration etc.) obtained from a total of 63 schizophrenia patients, each monitored for up to a year, were used for the clustering models and relapse prediction evaluation. Two clustering models, Gaussian Mixture Model (GMM) and Partition Around Medoids (PAM), were used to obtain behavioral representations from the mobile sensing data. The features obtained from the clustering models were used to train and evaluate a personalized relapse prediction model using Balanced Random Forest. The personalization was done by identifying optimal features for a given patient based on a personalization subset consisting of other patients who are of similar age. The clusters identified using the GMM and PAM models were found to represent different behavioral patterns (such as clusters representing sedentary days, active but with low communications days, etc.). Significant changes near the relapse periods were seen in the obtained behavioral representation features from the clustering models. The clustering model based features, together with other features characterizing the mobile sensing data, resulted in an F2 score of 0.24 for the relapse prediction task in a leave-one-patient-out evaluation setting. This obtained F2 score is significantly higher than a random classification baseline with an average F2 score of 0.042.


title: Quasiparticle tunneling as a probe of Josephson junction barrier and capacitor material in superconducting qubits

abstract: Non-equilibrium quasiparticles are possible sources for decoherence in superconducting qubits because they can lead to energy decay or dephasing upon tunneling across Josephson junctions (JJs). Here, we investigate the impact of the intrinsic properties of two-dimensional transmon qubits on quasiparticle tunneling (QPT) and discuss how we can use quasiparticle dynamics to gain critical information about the quality of JJ barrier. We find the tunneling rate of the nonequilibrium quasiparticles to be sensitive to the choice of the shunting capacitor material and their geometry in qubits. In some devices, we observe an anomalous temperature dependence of the QPT rate below 100 mK that deviates from a constant background associated with non-equilibrium quasiparticles. We speculate that this behavior is caused by high transmission sites/defects within the oxide barriers of the JJs, leading to spatially localized subgap states. We model this by assuming that such defects generate regions with a smaller effective gap. Our results present a unique in situ characterization tool to assess the uniformity of tunnel barriers in qubit junctions and shed light on how quasiparticles can interact with various elements of the qubit circuit.


title: Synchronicity for quantum non-local games

abstract: We introduce concurrent quantum non-local games, quantum output mirror games and concurrent classical-to-quantum non-local games, as quantum versions of synchronous non-local games, and provide tracial characterisations of their perfect strategies belonging to various correlation classes. We define *-algebras and C*-algebras of concurrent classical-to-quantum and concurrent quantum non-local games, and algebraic versions of the orthogonal rank of a graph. We show that quantum homomorphisms of quantum graphs can be viewed as entanglement assisted classical homomorphisms of the graphs, and give descriptions of the perfect quantum commuting and the perfect approximately quantum strategies for the quantum graph homomorphism game. We specialise the latter results to the case where the inputs of the game are based on a classical graph.


title: High Resolution Radar Sensing with Compressive Illumination

abstract: We present a compressive radar design that combines multitone linear frequency modulated (LFM) waveforms in the transmitter with a classical stretch processor and sub-Nyquist sampling in the receiver. The proposed compressive illumination scheme has fewer random elements resulting in reduced storage and complexity for implementation than previously proposed compressive radar designs based on stochastic waveforms. We analyze this illumination scheme for the task of a joint range-angle of arrival estimation in the multi-input and multi-output (MIMO) radar system. We present recovery guarantees for the proposed illumination technique. We show that for a sufficiently large number of modulating tones, the system achieves high-resolution in range and successfully recovers the range and angle-of-arrival of targets in a sparse scene. Furthermore, we present an algorithm that estimates the target range, angle of arrival, and scattering coefficient in the continuum. Finally, we present simulation results to illustrate the recovery performance as a function of system parameters.


title: Well-Founded Extensive Games with Perfect Information

abstract: We consider extensive games with perfect information with well-founded game trees and study the problems of existence and of characterization of the sets of subgame perfect equilibria in these games. We also provide such characterizations for two classes of these games in which subgame perfect equilibria exist: two-player zero-sum games with, respectively, two and three outcomes.


title: Uncertainty-Based Semantics for Multi-Agent Knowing How Logics

abstract: We introduce a new semantics for a multi-agent epistemic operator of knowing how, based on an indistinguishability relation between plans. Our proposal is, arguably, closer to the standard presentation of knowing that modalities in classical epistemic logic. We study the relationship between this semantics and previous approaches, showing that our setting is general enough to capture them. We also define a sound and complete axiomatization, and investigate the computational complexity of its model checking and satisfiability problems.


title: Revisiting Epistemic Logic with Names

abstract: This paper revisits the multi-agent epistemic logic presented in [10], where agents and sets of agents are replaced by abstract, intensional "names". We make three contributions. First, we study its model theory, providing adequate notions of bisimulation and frame morphisms, and use them to study the logic's expressive power and definability. Second, we show that the logic has a natural neighborhood semantics, which in turn allows to show that the axiomatization in [10] does not rely on possibly controversial introspective properties of knowledge. Finally, we extend the logic with common and distributed knowledge operators, and provide a sound and complete axiomatization for each of these extensions. These results together put the original epistemic logic with names in a more modern context and opens the door for a logical analysis of epistemic phenomena where group membership is uncertain or variable.


title: Language-based Decisions

abstract: In Savage's classic decision-theoretic framework, actions are formally defined as functions from states to outcomes. But where do the state space and outcome space come from? Expanding on recent work by Blume, Easley, and Halpern (BEH), we consider a language-based framework in which actions are identified with (conditional) descriptions in a simple underlying language, while states and outcomes (along with probabilities and utilities) are constructed as part of a representation theorem. Our work expands the role of language from that of BEH by using it not only for the conditions that determine which actions are taken, but also the effects. More precisely, we take the set of actions to be built from those of the form "do(phi)", for formulas phi in the underlying language. This presents a problem: how do we interpret the result of do(phi) when phi is underspecified (i.e., compatible with multiple states)? We answer this using tools familiar from the semantics of counterfactuals: roughly speaking, do(phi) maps each state to the "closest" phi-state. This notion of "closest" is also something we construct as part of the representation theorem; in effect, then, we prove that (under appropriate assumptions) the agent is acting as if each underspecified action is first made definite and then evaluated (i.e., by maximizing expected utility). Of course, actions in the real world are often not presented in a fully precise manner, yet agents reason about and form preferences among them all the same. Our work brings the abstract tools of decision theory into closer contact with such real-world scenarios.


title: An Awareness Epistemic Framework for Belief, Argumentation and Their Dynamics

abstract: The notion of argumentation and the one of belief stand in a problematic relation to one another. On the one hand, argumentation is crucial for belief formation: as the outcome of a process of arguing, an agent might come to (justifiably) believe that something is the case. On the other hand, beliefs are an input for argument evaluation: arguments with believed premisses are to be considered as strictly stronger by the agent to arguments whose premisses are not believed. An awareness epistemic logic that captures qualified versions of both principles was recently proposed in the literature. This paper extends that logic in three different directions. First, we try to improve its conceptual grounds, by depicting its philosophical foundations, critically discussing some of its design choices and exploring further possibilities. Second, we provide a (heretofore missing) completeness theorem for the basic fragment of the logic. Third, we study, using techniques from dynamic epistemic logic, how different forms of information change can be captured in the framework.


title: Collective Argumentation: The Case of Aggregating Support-Relations of Bipolar Argumentation Frameworks

abstract: In many real-life situations that involve exchanges of arguments, individuals may differ on their assessment of which supports between the arguments are in fact justified, i.e., they put forward different support-relations. When confronted with such situations, we may wish to aggregate individuals' argumentation views on support-relations into a collective view, which is acceptable to the group. In this paper, we assume that under bipolar argumentation frameworks, individuals are equipped with a set of arguments and a set of attacks between arguments, but with possibly different support-relations. Using the methodology in social choice theory, we analyze what semantic properties of bipolar argumentation frameworks can be preserved by aggregation rules during the aggregation of support-relations.


title: De Re Updates

abstract: In this paper, we propose a lightweight yet powerful dynamic epistemic logic that captures not only the distinction between de dicto and de re knowledge but also the distinction between de dicto and de re updates. The logic is based on the dynamified version of an epistemic language extended with the assignment operator borrowed from dynamic logic, following the work of Wang and Seligman (Proc. AiML 2018). We obtain complete axiomatizations for the counterparts of public announcement logic and event-model-based DEL based on new reduction axioms taking care of the interactions between dynamics and assignments.


title: No Finite Model Property for Logics of Quantified Announcements

abstract: Quantification over public announcements shifts the perspective from reasoning strictly about the results of a particular announcement to reasoning about the existence of an announcement that achieves some certain epistemic goal. Depending on the type of the quantification, we get different formalisms, the most known of which are arbitrary public announcement logic (APAL), group announcement logic (GAL), and coalition announcement logic (CAL). It has been an open question whether the logics have the finite model property, and in the paper we answer the question negatively. We also discuss how this result is connected to other open questions in the field.


title: Fire!

abstract: In this paper, we provide an epistemic analysis of a simple variant of the fundamental consistent broadcasting primitive for byzantine fault-tolerant asynchronous distributed systems. Our Firing Rebels with Relay (FRR) primitive enables agents with a local preference for acting/not acting to trigger an action (FIRE) at all correct agents, in an all-or-nothing fashion. By using the epistemic reasoning framework for byzantine multi-agent systems introduced in our TARK'19 paper, we develop the necessary and sufficient state of knowledge that needs to be acquired by the agents in order to FIRE. It involves eventual common hope (a modality related to belief), which we show to be attained already by achieving eventual mutual hope in the case of FRR. We also identify subtle variations of the necessary and sufficient state of knowledge for FRR for different assumptions on the local preferences.


title: Are the Players in an Interactive Belief Model Meta-certain of the Model Itself?

abstract: In an interactive belief model, are the players "commonly meta-certain" of the model itself? This paper formalizes such implicit "common meta-certainty" assumption. To that end, the paper expands the objects of players' beliefs from events to functions defined on the underlying states. Then, the paper defines a player's belief-generating map: it associates, with each state, whether a player believes each event at that state. The paper formalizes what it means by: "a player is (meta-)certain of her own belief-generating map" or "the players are (meta-)certain of the profile of belief-generating maps (i.e., the model)." The paper shows: a player is (meta-)certain of her own belief-generating map if and only if her beliefs are introspective. The players are commonly (meta-)certain of the model if and only if, for any event which some player i believes at some state, it is common belief at the state that player i believes the event. This paper then asks whether the "common meta-certainty" assumption is needed for an epistemic characterization of game-theoretic solution concepts. The paper shows: if each player is logical and (meta-)certain of her own strategy and belief-generating map, then each player correctly believes her own rationality. Consequently, common belief in rationality alone leads to actions that survive iterated elimination of strictly dominated actions.


title: Knowledge from Probability

abstract: We give a probabilistic analysis of inductive knowledge and belief and explore its predictions concerning knowledge about the future, about laws of nature, and about the values of inexactly measured quantities. The analysis combines a theory of knowledge and belief formulated in terms of relations of comparative normality with a probabilistic reduction of those relations. It predicts that only highly probable propositions are believed, and that many widely held principles of belief-revision fail.


title: Measuring Violations of Positive Involvement in Voting

abstract: In the context of computational social choice, we study voting methods that assign a set of winners to each profile of voter preferences. A voting method satisfies the property of positive involvement (PI) if for any election in which a candidate x would be among the winners, adding another voter to the election who ranks x first does not cause x to lose. Surprisingly, a number of standard voting methods violate this natural property. In this paper, we investigate different ways of measuring the extent to which a voting method violates PI, using computer simulations. We consider the probability (under different probability models for preferences) of PI violations in randomly drawn profiles vs. profile-coalition pairs (involving coalitions of different sizes). We argue that in order to choose between a voting method that satisfies PI and one that does not, we should consider the probability of PI violation conditional on the voting methods choosing different winners. We should also relativize the probability of PI violation to what we call voter potency, the probability that a voter causes a candidate to lose. Although absolute frequencies of PI violations may be low, after this conditioning and relativization, we see that under certain voting methods that violate PI, much of a voter's potency is turned against them - in particular, against their desire to see their favorite candidate elected.


title: Game-Theoretic Models of Moral and Other-Regarding Agents (extended abstract)

abstract: We investigate Kantian equilibria in finite normal form games, a class of non-Nashian, morally motivated courses of action that was recently proposed in the economics literature. We highlight a number of problems with such equilibria, including computational intractability, a high price of miscoordination, and problematic extension to general normal form games. We give such a generalization based on concept of program equilibria, and point out that that a practically relevant generalization may not exist. To remedy this we propose some general, intuitive, computationally tractable, other-regarding equilibria that are special cases Kantian equilibria, as well as a class of courses of action that interpolates between purely self-regarding and Kantian behavior.


title: Knowing How to Plan

abstract: Various planning-based know-how logics have been studied in the recent literature. In this paper, we use such a logic to do know-how-based planning via model checking. In particular, we can handle the higher-order epistemic planning involving know-how formulas as the goal, e.g., find a plan to make sure p such that the adversary does not know how to make p false in the future. We give a PTIME algorithm for the model checking problem over finite epistemic transition systems and axiomatize the logic under the assumption of perfect recall.


title: Reasoning about Emergence of Collective Memory

abstract: We offer a very simple model of how collective memory may form. Agents keep signalling within neighbourhoods, and depending on how many support each signal, some signals "win" in that neighbourhood. By agents interacting between different neighbourhoods, 'influence' spreads and sometimes, a collective signal emerges. We propose a logic in which we can reason about such emergence of memory and present preliminary technical results on the logic.


title: A Deontic Stit Logic Based on Beliefs and Expected Utility

abstract: The formalization of action and obligation using logic languages is a topic of increasing relevance in the field of ethics for AI. Having an expressive syntactic and semantic framework to reason about agents' decisions in moral situations allows for unequivocal representations of components of behavior that are relevant when assigning blame (or praise) of outcomes to said agents. Two very important components of behavior in this respect are belief and belief-based action. In this work we present a logic of doxastic oughts by extending epistemic deontic stit theory with beliefs. On one hand, the semantics for formulas involving belief operators is based on probability measures. On the other, the semantics for doxastic oughts relies on a notion of optimality, and the underlying choice rule is maximization of expected utility. We introduce an axiom system for the resulting logic, and we address its soundness, completeness, and decidability results. These results are significant in the line of research that intends to use proof systems of epistemic, doxastic, and deontic logics to help in the testing of ethical behavior of AI through theorem-proving and model-checking.


title: Epistemic Modality and Coordination under Uncertainty

abstract: Communication facilitates coordination, but coordination might fail if there's too much uncertainty. I discuss a scenario in which vagueness-driven uncertainty undermines the possibility of publicly sharing a belief. I then show that asserting an epistemic modal sentence, 'Might p', can reveal the speaker's uncertainty, and that this may improve the chances of coordination despite the lack of a common epistemic ground. This provides a game-theoretic rationale for epistemic modality. The account draws on a standard relational semantics for epistemic modality, Stalnaker's theory of assertion as informative update, and a Bayesian framework for reasoning under uncertainty.


title: Communication Pattern Models: An Extension of Action Models for Dynamic-Network Distributed Systems

abstract: Halpern and Moses were the first to recognize, in 1984, the importance of a formal treatment of knowledge in distributed computing. Many works in distributed computing, however, still employ informal notions of knowledge. Hence, it is critical to further study such formalizations. Action models, a significant approach to modeling dynamic epistemic logic, have only recently been applied to distributed computing, for instance, by Goubault, Ledent, and Rajsbaum. Using action models for analyzing distributed-computing environments, as proposed by these authors, has drawbacks, however. In particular, a direct use of action models may cause such models to grow exponentially as the computation of the distributed system evolves. Hence, our motivation is finding compact action models for distributed systems. We introduce communication pattern models as an extension of both ordinary action models and their update operator. We give a systematic construction of communication pattern models for a large variety of distributed-computing models called dynamic-network models. For a proper subclass of dynamic-network models called oblivious, the communication pattern model remains the same throughout the computation.


title: Controlled plasmon-enhanced fluorescence by spherical microcavity

abstract: A surrounding electromagnetic environment can engineer spontaneous emissions from quantum emitters through the Purcell effect. For instance, a plasmonic antenna can efficiently confine an electromagnetic field and enhance the fluorescent process. In this study, we demonstrate that a photonic microcavity can modulate plasmon-enhanced fluorescence by engineering the local electromagnetic environment. Consequently, we constructed a plasmon-enhanced emitter (PE-emitter), which comprised a nanorod and a nanodiamond, using the nanomanipulation technique. Furthermore, we controlled a polystyrene sphere approaching the PE-emitter and investigated in situ the associated fluorescent spectrum and lifetime. The emission of PE-emitter can be enhanced resonantly at the photonic modes as compared to that within the free spectral range. The spectral shape modulated by photonic modes is independent of the separation between the PS sphere and PE-emitter. The band integral of the fluorescence decay rate can be enhanced or suppressed after the PS sphere couples to the PE-emitters, depending on the coupling strength between the plasmonic antenna and the photonic cavity. These findings can be utilized in sensing and imaging applications.


title: Sub- and Super-solution Approach to Accuracy Analysis of Portfolio Optimization Asymptotics in Multiscale Stochastic Factor Market

abstract: The problem of portfolio optimization when stochastic factors drive returns and volatilities has been studied in previous works by the authors. In particular, they proposed asymptotic approximations for value functions and optimal strategies in the regime where these factors are running on both slow and fast timescales. However, the rigorous justification of the accuracy of these approximations has been limited to power utilities and a single factor. In this paper, we provide an accurate analysis for cases with general utility functions and two timescale factors by constructing sub- and super-solutions to the fully nonlinear problem so that their difference is at the desired level of accuracy. This approach will be valuable in various related stochastic control problems.


title: Information Thermodynamics of the Transition-Path Ensemble

abstract: The reaction coordinate describing a transition between reactant and product is a fundamental concept in the theory of chemical reactions. Within transition-path theory, a quantitative definition of the reaction coordinate is found in the committor, which is the probability that a trajectory initiated from a given microstate first reaches the product before the reactant. Here we develop an information-theoretic origin for the committor and show how selecting transition paths from the equilibrium ensemble induces entropy production which exactly equals the information that system dynamics provide about the reactivity of trajectories. This equality of entropy production and dynamical information generation also holds at the level of arbitrary individual coordinates, providing parallel measures of the coordinate's relevance to the reaction, each of which is maximized by the committor.


title: An Accurate Non-accelerometer-based PPG Motion Artifact Removal Technique using CycleGAN

abstract: A photoplethysmography (PPG) is an uncomplicated and inexpensive optical technique widely used in the healthcare domain to extract valuable health-related information, e.g., heart rate variability, blood pressure, and respiration rate. PPG signals can easily be collected continuously and remotely using portable wearable devices. However, these measuring devices are vulnerable to motion artifacts caused by daily life activities. The most common ways to eliminate motion artifacts use extra accelerometer sensors, which suffer from two limitations: i) high power consumption and ii) the need to integrate an accelerometer sensor in a wearable device (which is not required in certain wearables). This paper proposes a low-power non-accelerometer-based PPG motion artifacts removal method outperforming the accuracy of the existing methods. We use Cycle Generative Adversarial Network to reconstruct clean PPG signals from noisy PPG signals. Our novel machine-learning-based technique achieves 9.5 times improvement in motion artifact removal compared to the state-of-the-art without using extra sensors such as an accelerometer.


title: A CCCZ gate performed with 6 T gates

abstract: We construct a CCCZ gate using six T gates, assisted by stabilizer operations and classical feedback. More generally, we reduce the T cost of a $C^{n}Z$ gate from $4n-4$ to $4n-6$, for $n > 2$.


title: Rethinking Adam: A Twofold Exponential Moving Average Approach

abstract: Adaptive gradient methods, e.g. \textsc{Adam}, have achieved tremendous success in machine learning. Scaling the learning rate element-wisely by a certain form of second moment estimate of gradients, such methods are able to attain rapid training of modern deep neural networks. Nevertheless, they are observed to suffer from compromised generalization ability compared with stochastic gradient descent (\textsc{SGD}) and tend to be trapped in local minima at an early stage during training. Intriguingly, we discover that substituting the gradient in the second raw moment estimate term with its momentumized version in \textsc{Adam} can resolve the issue. The intuition is that gradient with momentum contains more accurate directional information and therefore its second moment estimation is a more favorable option for learning rate scaling than that of the raw gradient. Thereby we propose \textsc{AdaMomentum} as a new optimizer reaching the goal of training fast while generalizing much better. We further develop a theory to back up the improvement in generalization and provide convergence guarantees under both convex and nonconvex settings. Extensive experiments on a wide range of tasks and models demonstrate that \textsc{AdaMomentum} exhibits state-of-the-art performance and superior training stability consistently.


title: Cooperative mmWave PHD-SLAM with Moving Scatterers

abstract: Using the multiple-model (MM) probability hypothesis density (PHD) filter, millimeter wave (mmWave) radio simultaneous localization and mapping (SLAM) in vehicular scenarios is susceptible to movements of objects, in particular vehicles driving in parallel with the ego vehicle. We propose and evaluate two countermeasures to track vehicle scatterers (VSs) in mmWave radio MM-PHD-SLAM. First, locally at each vehicle, we generate and treat the VS map PHD in the context of Bayesian recursion, and modify vehicle state correction with the VS map PHD. Second, in the global map fusion process at the base station, we average the VS map PHD and upload it with self-vehicle posterior density, compute fusion weights, and prune the target with low Gaussian weight in the context of arithmetic average-based map fusion. From simulation results, the proposed cooperative mmWave radio MM-PHD-SLAM filter is shown to outperform the previous filter in VS scenarios.


title: SA-LOAM: Semantic-aided LiDAR SLAM with Loop Closure

abstract: LiDAR-based SLAM system is admittedly more accurate and stable than others, while its loop closure detection is still an open issue. With the development of 3D semantic segmentation for point cloud, semantic information can be obtained conveniently and steadily, essential for high-level intelligence and conductive to SLAM. In this paper, we present a novel semantic-aided LiDAR SLAM with loop closure based on LOAM, named SA-LOAM, which leverages semantics in odometry as well as loop closure detection. Specifically, we propose a semantic-assisted ICP, including semantically matching, downsampling and plane constraint, and integrates a semantic graph-based place recognition method in our loop closure detection module. Benefitting from semantics, we can improve the localization accuracy, detect loop closures effectively, and construct a global consistent semantic map even in large-scale scenes. Extensive experiments on KITTI and Ford Campus dataset show that our system significantly improves baseline performance, has generalization ability to unseen data and achieves competitive results compared with state-of-the-art methods.


title: Fine-tune the Entire RAG Architecture (including DPR retriever) for Question-Answering

abstract: In this paper, we illustrate how to fine-tune the entire Retrieval Augment Generation (RAG) architecture in an end-to-end manner. We highlighted the main engineering challenges that needed to be addressed to achieve this objective. We also compare how end-to-end RAG architecture outperforms the original RAG architecture for the task of question answering. We have open-sourced our implementation in the HuggingFace Transformers library.


title: AGB interlopers in YSO catalogues hunted out by NEOWISE

abstract: AGBs and YSOs often share the same domains in IR color-magnitude or color-color diagrams leading to potential mis-classification. We extracted a list of AGB interlopers from the published YSO catalogues using the periodogram analysis on NEOWISE time series data. YSO IR variability is typically stochastic and linked to episodic mass accretion. Furthermore, most variable YSOs are at an early evolutionary stage, with significant surrounding envelope and/or disk material. In contrast, AGBs are often identified by a well defined sinusoidal variability with periods of a few hundreds days. From our periodogram analysis of all known low mass YSOs in the Gould Belt, we find 85 AGB candidates, out of which 62 were previously classified as late-stage Class III YSOs. Most of these new AGB candidates have similar IR colors to O-rich AGBs. We observed 73 of these AGB candidates in the H2O, CH3OH and SiO maser lines to further reveal their nature. The SiO maser emission was detected in 10 sources, confirming them as AGBs since low mass YSOs, especially Class III YSOs, do not show such maser emission. The H2O and CH3OH maser lines were detected in none of our targets.


title: Agnostic Reinforcement Learning with Low-Rank MDPs and Rich Observations

abstract: There have been many recent advances on provably efficient Reinforcement Learning (RL) in problems with rich observation spaces. However, all these works share a strong realizability assumption about the optimal value function of the true MDP. Such realizability assumptions are often too strong to hold in practice. In this work, we consider the more realistic setting of agnostic RL with rich observation spaces and a fixed class of policies $\Pi$ that may not contain any near-optimal policy. We provide an algorithm for this setting whose error is bounded in terms of the rank $d$ of the underlying MDP. Specifically, our algorithm enjoys a sample complexity bound of $\widetilde{O}\left((H^{4d} K^{3d} \log |\Pi|)/\epsilon^2\right)$ where $H$ is the length of episodes, $K$ is the number of actions and $\epsilon>0$ is the desired sub-optimality. We also provide a nearly matching lower bound for this agnostic setting that shows that the exponential dependence on rank is unavoidable, without further assumptions.


title: BARTScore: Evaluating Generated Text as Text Generation

abstract: A wide variety of NLP applications, such as machine translation, summarization, and dialog, involve text generation. One major challenge for these applications is how to evaluate whether such generated texts are actually fluent, accurate, or effective. In this work, we conceptualize the evaluation of generated text as a text generation problem, modeled using pre-trained sequence-to-sequence models. The general idea is that models trained to convert the generated text to/from a reference output or the source text will achieve higher scores when the generated text is better. We operationalize this idea using BART, an encoder-decoder based pre-trained model, and propose a metric BARTScore with a number of variants that can be flexibly applied in an unsupervised fashion to evaluation of text from different perspectives (e.g. informativeness, fluency, or factuality). BARTScore is conceptually simple and empirically effective. It can outperform existing top-scoring metrics in 16 of 22 test settings, covering evaluation of 16 datasets (e.g., machine translation, text summarization) and 7 different perspectives (e.g., informativeness, factuality). Code to calculate BARTScore is available at https://github.com/neulab/BARTScore, and we have released an interactive leaderboard for meta-evaluation at http://explainaboard.nlpedia.ai/leaderboard/task-meval/ on the ExplainaBoard platform, which allows us to interactively understand the strengths, weaknesses, and complementarity of each metric.


title: ESR: Ethics and Society Review of Artificial Intelligence Research

abstract: Artificial intelligence (AI) research is routinely criticized for its real and potential impacts on society, and we lack adequate institutional responses to this criticism and to the responsibility that it reflects. AI research often falls outside the purview of existing feedback mechanisms such as the Institutional Review Board (IRB), which are designed to evaluate harms to human subjects rather than harms to human society. In response, we have developed the Ethics and Society Review board (ESR), a feedback panel that works with researchers to mitigate negative ethical and societal aspects of AI research. The ESR's main insight is to serve as a requirement for funding: researchers cannot receive grant funding from a major AI funding program at our university until the researchers complete the ESR process for the proposal. In this article, we describe the ESR as we have designed and run it over its first year across 41 proposals. We analyze aggregate ESR feedback on these proposals, finding that the panel most commonly identifies issues of harms to minority groups, inclusion of diverse stakeholders in the research plan, dual use, and representation in data. Surveys and interviews of researchers who interacted with the ESR found that 58% felt that it had influenced the design of their research project, 100% are willing to continue submitting future projects to the ESR, and that they sought additional scaffolding for reasoning through ethics and society issues.


title: Total Least Squares for Optimal Pose Estimation

abstract: This work provides a theoretical framework for the pose estimation problem using total least squares for vector observations from landmark features. First, the optimization framework is formulated with observation vectors extracted from point cloud features. Then, error-covariance expressions are derived. The attitude and position solutions obtained via the derived optimization framework are proven to reach the bounds defined by the Cram\'er-Rao lower bound under the small-angle approximation of attitude errors. The measurement data for the simulation of this problem is provided through a series of vector observation scans, and a fully populated observation noise-covariance matrix is assumed as the weight in the cost function to cover the most general case of the sensor uncertainty. Here, previous derivations are expanded for the pose estimation problem to include more generic correlations in the errors than previous cases involving an isotropic noise assumption. The proposed solution is simulated in a Monte-Carlo framework to validate the error-covariance analysis.


title: Observation of van der Waals phonons in the single-layer cuprate (Bi,Pb)$_2$(Sr,La)$_2$CuO$_{6+\delta}$

abstract: Interlayer van der Waals (vdW) coupling is generic in two-dimensional materials such as graphene and transition metal dichalcogenides, which can induce very low-energy phonon modes. Using high-resolution inelastic hard x-ray scattering, we uncover the ultra-low energy phonon mode along the Cu-O bond direction in the high-$T_c$ cuprate (Bi,Pb)$_2$(Sr,La)$_2$CuO$_{6+\delta}$ (Bi2201). This mode is independent of temperature, while its intensity decreases with doping in accordance with an increasing c-axis lattice parameter. We compare the experimental results to first-principles density functional theory simulations and identify the observed mode as a van der Waals phonon, which arises from the shear motion of the adjacent Bi-O layers. This shows that Bi-based cuprate has similar vibrational properties as graphene and transition metal dichalcogenides, which can be exploited to engineer novel heterostructures.


title: On Minimizing Symbol Error Rate Over Fading Channels with Low-Resolution Quantization

abstract: We analyze the symbol error probability (SEP) of $M$-ary pulse amplitude modulation ($M$-PAM) receivers equipped with optimal low-resolution quantizers. We first show that the optimum detector can be reduced to a simple decision rule. Using this simplification, an exact SEP expression for quantized $M$-PAM receivers is obtained when Nakagami-$m$ fading channel is considered. The derived expression enables the optimization of the quantizer and/or constellation under the minimum SEP criterion. Our analysis of optimal quantization for equidistant $M$-PAM receiver reveals the existence of error floor which decays at a double exponential rate with increasing quantization bits, $b$. Moreover, by also allowing the transmitter to optimize the constellation based on the statistics of the fading channel, we prove that the error floor can be eliminated but at a lower decay exponent than the unquantized case. Characterization of this decay exponent is provided in this paper. We also expose the outage performance limitations of SEP-optimal uniform quantizers. To be more precise, its decay exponent does not improve with $b$. Lastly, we demonstrate that the decay exponent of a quantized receiver can be complemented by receive antenna diversity techniques.


title: Global dynamics in a chemotaxis model describing tumor angiogenesis with/without mitosis in any dimensions

abstract: In this work, we study the Neumann initial boundary value problem for a three-component chemotaxis model in any dimensional bounded and smooth domains; this model is used to describe the branching of capillary sprouts during angiogenesis. First, we find three qualitatively simple sufficient conditions for qualitative global boundedness, and then, we establish two types of global stability for bounded solutions in qualitative ways. As a consequence of our findings, the underlying system without chemotaxis and the effect of ECs mitosis can not give rise to pattern formations. Our findings quantify and extend significantly previous studies, which are set in lower dimensional convex domains and are with no qualitative information.


title: Crepant resolutions of quotient varieties in positive characteristics and their Euler characteristics

abstract: In characteristic zero, if a quotient variety has a crepant resolution, the Euler characteristic of the crepant resolution is equal to the number of conjugacy classes of the acting group, by Batyrev's theorem. This is one of the McKay correspondence. It is natural to consider the analogue statement in the positive characteristic. In this paper, we present sequences of crepant resolutions of quotient varieties in the positive characteristic and show that one of the sequences gives a counterexample to the analogue statement of Batyrev's theorem.


title: Four new PLanetesimals Around TYpical and Pre-main seqUence Stars (PLATYPUS) Debris Discs at 8.8mm

abstract: Millimetre continuum observations of debris discs can provide insights into the physical and dynamical properties of the unseen planetesimals that these discs host. The material properties and collisional models of planetesimals leave their signature on the grain size distribution, which can be traced through the millimetre spectral index. We present 8.8 mm observations of the debris discs HD 48370, CPD 72 2713, HD 131488, and HD 32297 using the Australian Telescope Compact Array (ATCA) as part of the PLanetesimals Around TYpicalPre-main seqUence Stars (PLATYPUS) survey. We detect all four targets with a characteristic beam size of 5 arcseconds and derive a grain size distribution parameter that is consistent with collisional cascade models and theoretical predictions for parent planetesimal bodies where binding is dominated by self-gravity. We combine our sample with 19 other millimetre-wavelength detected debris discs from the literature and calculate a weighted mean grain size power law index which is close to analytical predictions for a classical steady state collisional cascade model. We suggest the possibility of two distributions of q in our debris disc sample; a broad distribution (where q is approximately 3.2 to 3.7) for "typical" debris discs (gas-poor/non-detection), and a narrow distribution (where q is less than 3.2) for bright gas-rich discs. Or alternatively, we suggest that there exists an observational bias between the grain size distribution parameter and absolute flux which may be attributed to the detection rates of faint debris discs at cm wavelengths.


title: Recent Deep Semi-supervised Learning Approaches and Related Works

abstract: The author of this work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist few formidable constraints including the need for a large amount of labeled data. Therefore, semi-supervised learning, which is a learning scheme in which the scarce labels and a larger amount of unlabeled data are utilized to train models (e.g., deep neural networks) is getting more important. Based on the key assumptions of semi-supervised learning, which are the manifold assumption, cluster assumption, and continuity assumption, the work reviews the recent semi-supervised learning approaches. In particular, the methods in regard to using deep neural networks in a semi-supervised learning setting are primarily discussed. In addition, the existing works are first classified based on the underlying idea and explained, and then the holistic approaches that unify the aforementioned ideas are detailed.


title: Unraveling the secrets of turbulence in a fluid puff

abstract: Turbulent puffs are ubiquitous in everyday life phenomena. Understanding their dynamics is important in a variety of situations ranging from industrial processes to pure and applied science. In all these fields, a deep knowledge of the statistical structure of temperature and velocity space/time fluctuations is of paramount importance to construct models of chemical reaction (in chemistry), of condensation of virus-containing droplets (in virology and/or biophysics), and optimal mixing strategies in industrial applications. As a matter of fact, results of turbulence in a puff are confined to bulk properties (i.e. average puff velocity and typical decay/growth time) and dates back to the second half of the 20th century. There is thus a huge gap to fill to pass from bulk properties to two-point statistical observables. Here we fill this gap exploiting theory and numerics in concert to predict and validate the space/time scaling behaviors of both velocity and temperature structure functions including intermittency corrections. Excellent agreement between theory and simulations is found. Our results are expected to have profound impact to develop evaporation models for virus-containing droplets carried by a turbulent puff, with benefits to the comprehension of the airborne route of virus contagion.


title: To the problem of electron-hole bound state in transition-metal dichalcogenides

abstract: The interacting electron and hole in transition-metal dichalcogenides is considered. For investigation of the interaction between electron and hole we obtain the Bethe-Salpeter equation for two interacting Dirac particles. The dependence of a few lowest binding energies of electron and hole on the interaction constant for different potentials is found. We demonstrate that the behavior of the potential at small distances significantly affects on the values of the binding energies. For small interaction constant we have developed the perturbative method of the binding energy calculation. For the largre interaction constant the binding energies are found numerically. The critical values of the interaction constant for the Coulomb potential and exponential potential are found.


title: Graph Routing between Capsules

abstract: Routing methods in capsule networks often learn a hierarchical relationship for capsules in successive layers, but the intra-relation between capsules in the same layer is less studied, while this intra-relation is a key factor for the semantic understanding in text data. Therefore, in this paper, we introduce a new capsule network with graph routing to learn both relationships, where capsules in each layer are treated as the nodes of a graph. We investigate strategies to yield adjacency and degree matrix with three different distances from a layer of capsules, and propose the graph routing mechanism between those capsules. We validate our approach on five text classification datasets, and our findings suggest that the approach combining bottom-up routing and top-down attention performs the best. Such an approach demonstrates generalization capability across datasets. Compared to the state-of-the-art routing methods, the improvements in accuracy in the five datasets we used were 0.82, 0.39, 0.07, 1.01, and 0.02, respectively.


title: Key-Sparse Transformer for Multimodal Speech Emotion Recognition

abstract: Speech emotion recognition is a challenging research topic that plays a critical role in human-computer interaction. Multimodal inputs further improve the performance as more emotional information is used. However, existing studies learn all the information in the sample while only a small portion of it is about emotion. The redundant information will become noises and limit the system performance. In this paper, a key-sparse Transformer is proposed for efficient emotion recognition by focusing more on emotion related information. The proposed method is evaluated on the IEMOCAP and LSSED. Experimental results show that the proposed method achieves better performance than the state-of-the-art approaches.


title: Do Language Models Perform Generalizable Commonsense Inference?

abstract: Inspired by evidence that pretrained language models (LMs) encode commonsense knowledge, recent work has applied LMs to automatically populate commonsense knowledge graphs (CKGs). However, there is a lack of understanding on their generalization to multiple CKGs, unseen relations, and novel entities. This paper analyzes the ability of LMs to perform generalizable commonsense inference, in terms of knowledge capacity, transferability, and induction. Our experiments with these three aspects show that: (1) LMs can adapt to different schemas defined by multiple CKGs but fail to reuse the knowledge to generalize to new relations. (2) Adapted LMs generalize well to unseen subjects, but less so on novel objects. Future work should investigate how to improve the transferability and induction of commonsense mining from LMs.


title: Turing Award elites revisited: patterns of productivity, collaboration, authorship and impact

abstract: The Turing Award is recognized as the most influential and prestigious award in the field of computer science(CS). With the rise of the science of science (SciSci), a large amount of bibliographic data has been analyzed in an attempt to understand the hidden mechanism of scientific evolution. These include the analysis of the Nobel Prize, including physics, chemistry, medicine, etc. In this article, we extract and analyze the data of 72 Turing Award laureates from the complete bibliographic data, fill the gap in the lack of Turing Award analysis, and discover the development characteristics of computer science as an independent discipline. First, we show most Turing Award laureates have long-term and high-quality educational backgrounds, and more than 61% of them have a degree in mathematics, which indicates that mathematics has played a significant role in the development of computer science. Secondly, the data shows that not all scholars have high productivity and high h-index; that is, the number of publications and h-index is not the leading indicator for evaluating the Turing Award. Third, the average age of awardees has increased from 40 to around 70 in recent years. This may be because new breakthroughs take longer, and some new technologies need time to prove their influence. Besides, we have also found that in the past ten years, international collaboration has experienced explosive growth, showing a new paradigm in the form of collaboration. It is also worth noting that in recent years, the emergence of female winners has also been eye-catching. Finally, by analyzing the personal publication records, we find that many people are more likely to publish high-impact articles during their high-yield periods.


title: Particle Cloud Generation with Message Passing Generative Adversarial Networks

abstract: In high energy physics (HEP), jets are collections of correlated particles produced ubiquitously in particle collisions such as those at the CERN Large Hadron Collider (LHC). Machine learning (ML)-based generative models, such as generative adversarial networks (GANs), have the potential to significantly accelerate LHC jet simulations. However, despite jets having a natural representation as a set of particles in momentum-space, a.k.a. a particle cloud, there exist no generative models applied to such a dataset. In this work, we introduce a new particle cloud dataset (JetNet), and apply to it existing point cloud GANs. Results are evaluated using (1) 1-Wasserstein distances between high- and low-level feature distributions, (2) a newly developed Fr\'{e}chet ParticleNet Distance, and (3) the coverage and (4) minimum matching distance metrics. Existing GANs are found to be inadequate for physics applications, hence we develop a new message passing GAN (MPGAN), which outperforms existing point cloud GANs on virtually every metric and shows promise for use in HEP. We propose JetNet as a novel point-cloud-style dataset for the ML community to experiment with, and set MPGAN as a benchmark to improve upon for future generative models. Additionally, to facilitate research and improve accessibility and reproducibility in this area, we release the open-source JetNet Python package with interfaces for particle cloud datasets, implementations for evaluation and loss metrics, and more tools for ML in HEP development.


title: Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images

abstract: We introduce an approach that accurately reconstructs 3D human poses and detailed 3D full-body geometric models from single images in realtime. The key idea of our approach is a novel end-to-end multi-task deep learning framework that uses single images to predict five outputs simultaneously: foreground segmentation mask, 2D joints positions, semantic body partitions, 3D part orientations and uv coordinates (uv map). The multi-task network architecture not only generates more visual cues for reconstruction, but also makes each individual prediction more accurate. The CNN regressor is further combined with an optimization based algorithm for accurate kinematic pose reconstruction and full-body shape modeling. We show that the realtime reconstruction reaches accurate fitting that has not been seen before, especially for wild images. We demonstrate the results of our realtime 3D pose and human body reconstruction system on various challenging in-the-wild videos. We show the system advances the frontier of 3D human body and pose reconstruction from single images by quantitative evaluations and comparisons with state-of-the-art methods.


title: Information of income position and its impact on perceived tax burden and preference for redistribution: An Internet Survey Experiment

abstract: A customized internet survey experiment is conducted in Japan to examine how individuals' relative income position influences preferences for income redistribution and individual perceptions regarding income tax burden. I first asked respondents about their perceived income position in their country and their preferences for redistribution and perceived tax burden. In the follow-up survey for the treatment group, I provided information on their true income position and asked the same questions as in the first survey. For the control group, I did not provide their true income position and asked the same questions. I gathered a large sample that comprised observations of the treatment group (4,682) and the control group (2,268). The key findings suggest that after being informed of individuals' real income position, (1) individuals who thought their income position was higher than the true one perceived their tax burden to be larger, (2) individuals' preference for redistribution hardly changes, and (3) irreciprocal individuals perceive their tax burden to be larger and are more likely to prefer redistribution. However, the share of irreciprocal ones is small. This leads Japan to be a non-welfare state.


title: Optimizing for Strategy Diversity in the Design of Video Games

abstract: We consider the problem of designing a linear program that has diverse solutions as the right-hand side varies. This problem arises in video game settings where designers aim to have players use different "weapons" or "tactics" as they progress. We model this design question as a choice over the constraint matrix $A$ and cost vector $c$ to maximize the number of possible \emph{supports} of unique optimal solutions (what we call "loadouts") of Linear Programs $\max\{c^\top x \mid Ax \le b, x \ge 0\}$ with nonnegative data considered over all resource vectors $b$. We provide an upper bound on the optimal number of loadouts and provide a family of constructions that have an asymptotically optimal number of loadouts. The upper bound is based on a connection between our problem and the study of triangulations of point sets arising from polyhedral combinatorics, and specifically the combinatorics of the cyclic polytope. Our asymptotically optimal construction also draws inspiration from the properties of the cyclic polytope.


title: DocFormer: End-to-End Transformer for Document Understanding

abstract: We present DocFormer -- a multi-modal transformer based architecture for the task of Visual Document Understanding (VDU). VDU is a challenging problem which aims to understand documents in their varied formats (forms, receipts etc.) and layouts. In addition, DocFormer is pre-trained in an unsupervised fashion using carefully designed tasks which encourage multi-modal interaction. DocFormer uses text, vision and spatial features and combines them using a novel multi-modal self-attention layer. DocFormer also shares learned spatial embeddings across modalities which makes it easy for the model to correlate text to visual tokens and vice versa. DocFormer is evaluated on 4 different datasets each with strong baselines. DocFormer achieves state-of-the-art results on all of them, sometimes beating models 4x its size (in no. of parameters).


title: On Selection Criteria for the Tuning Parameter in Robust Divergence

abstract: While robust divergence such as density power divergence and $\gamma$-divergence is helpful for robust statistical inference in the presence of outliers, the tuning parameter that controls the degree of robustness is chosen in a rule-of-thumb, which may lead to an inefficient inference. We here propose a selection criterion based on an asymptotic approximation of the Hyvarinen score applied to an unnormalized model defined by robust divergence. The proposed selection criterion only requires first and second-order partial derivatives of an assumed density function with respect to observations, which can be easily computed regardless of the number of parameters. We demonstrate the usefulness of the proposed method via numerical studies using normal distributions and regularized linear regression.


title: Kernel Clustering with Sigmoid-based Regularization for Efficient Segmentation of Sequential Data

abstract: Kernel segmentation aims at partitioning a data sequence into several non-overlapping segments that may have nonlinear and complex structures. In general, it is formulated as a discrete optimization problem with combinatorial constraints. A popular algorithm for optimally solving this problem is dynamic programming (DP), which has quadratic computation and memory requirements. Given that sequences in practice are too long, this algorithm is not a practical approach. Although many heuristic algorithms have been proposed to approximate the optimal segmentation, they have no guarantee on the quality of their solutions. In this paper, we take a differentiable approach to alleviate the aforementioned issues. First, we introduce a novel sigmoid-based regularization to smoothly approximate the combinatorial constraints. Combining it with objective of the balanced kernel clustering, we formulate a differentiable model termed Kernel clustering with sigmoid-based regularization (KCSR), where the gradient-based algorithm can be exploited to obtain the optimal segmentation. Second, we develop a stochastic variant of the proposed model. By using the stochastic gradient descent algorithm, which has much lower time and space complexities, for optimization, the second model can perform segmentation on overlong data sequences. Finally, for simultaneously segmenting multiple data sequences, we slightly modify the sigmoid-based regularization to further introduce an extended variant of the proposed model. Through extensive experiments on various types of data sequences performances of our models are evaluated and compared with those of the existing methods. The experimental results validate advantages of the proposed models. Our Matlab source code is available on github.


title: Connection Sensitivity Matters for Training-free DARTS: From Architecture-Level Scoring to Operation-Level Sensitivity Analysis

abstract: The recently proposed training-free NAS methods abandon the training phase and design various zero-cost proxies as scores to identify excellent architectures, arousing extreme computational efficiency for neural architecture search. In this paper, we raise an interesting problem: can we properly measure the operation importance in DARTS through a training-free way, with avoiding the parameter-intensive bias? We investigate this question through the lens of edge connectivity, and provide an affirmative answer by defining a connectivity concept, ZERo-cost Operation Sensitivity (ZEROS), to score the importance of candidate operations in DARTS at initialization. By devising an iterative and data-agnostic manner in utilizing ZEROS for NAS, our novel trial leads to a framework called training free differentiable architecture search (FreeDARTS). Based on the theory of Neural Tangent Kernel (NTK), we show the proposed connectivity score provably negatively correlated with the generalization bound of DARTS supernet after convergence under gradient descent training. In addition, we theoretically explain how ZEROS implicitly avoids parameter-intensive bias in selecting architectures, and empirically show the searched architectures by FreeDARTS are of comparable size. Extensive experiments have been conducted on a series of search spaces, and results have demonstrated that FreeDARTS is a reliable and efficient baseline for neural architecture search.


title: Collisions of micron-sized, charged water droplets in still air

abstract: We investigate the effect of electrical charge on collisions of hydrodynamically interacting, micron-sized water droplets settling through quiescent air. The relative dynamics of charged droplets is determined by hydrodynamic interactions, particle and fluid inertia, and electrostatic forces. We analyse the resulting relative dynamics of oppositely charged droplets by determining its fixed points and their stable and unstable manifolds. The stable manifold of a saddle point forms a separatrix that separates colliding trajectories from those that do not collide. The qualitative conclusions from this theory are in excellent agreement with experiments.


title: On Dynamical Cancellation

abstract: Let $X$ be a projective variety and let $f$ be a dominant endomorphism of $X$, both of which are defined over a number field $K$. We consider a question of the second author, Meng, Shibata, and Zhang, which asks whether the tower of $K$-points $Y(K)\subseteq (f^{-1}(Y))(K)\subseteq (f^{-2}(Y))(K)\subseteq \cdots$ eventually stabilizes, where $Y\subset X$ is a subvariety invariant under $f$. We show this question has an affirmative answer when the map $f$ is \'etale. We also look at a related problem of showing that there is some integer $s_0$, depending only on $X$ and $K$, such that whenever $x, y \in X(K)$ have the property that $f^{s}(x) = f^{s}(y)$ for some $s \geq 0$, we necessarily have $f^{s_{0}}(x) = f^{s_{0}}(y)$. We prove this holds for \'etale morphisms of projective varieties, as well as self-morphisms of smooth projective curves. We also prove a more general cancellation theorem for polynomial maps on $\mathbb{P}^1$ where we allow for composition by multiple different maps $f_1,\dots,f_r$.


title: Predictive multiview embedding

abstract: Multiview embedding is a way to model strange attractors that takes advantage of the way measurements are often made in real chaotic systems, using multidimensional measurements to make up for a lack of long timeseries. Predictive multiview embedding adapts this approach to the problem of predicting new values, and provides a natural framework for combining multiple sources of information such as natural measurements and computer model runs for potentially improved prediction. Here, using 18 month ahead prediction of monthly averages, we show how predictive multiview embedding can be combined with simple statistical approaches to explore predictability of four climate variables by a GCM, build prediction bounds, explore the local manifold structure of the attractor, and show that even though the GCM does not predict a particular variable well, a hybrid model combining information from the GCM and empirical data predicts that variable significantly better than the purely empirical model.


title: Isometries and hermitian operators on spaces of vector-valued Lipschitz maps

abstract: We study hermitian operators and isometries on spaces of vector-valued Lipschitz maps with the sum norm: $\|\cdot\|_{\infty}+L(\cdot)$. There are two main theorems in this paper. Firstly, we prove that every hermitian operator on $\operatorname{Lip}(X,E)$, where $E$ is a complex Banach space, is a generalized composition operator. Secondly, we give a complete description of unital surjective complex linear isometries on $\operatorname{Lip}(X,\mathcal{A})$ where $\mathcal{A}$ is a unital factor $C^{*}$-algebra. These results improve previous results stated by the author.


title: On the Douglas-Rachford algorithm for solving possibly inconsistent optimization problems

abstract: More than 40 years ago, Lions and Mercier introduced in a seminal paper the Douglas-Rachford algorithm. Today, this method is well recognized as a classical and highly successful splitting method to find minimizers of the sum of two (not necessarily smooth) convex functions. While the underlying theory has matured, one case remains a mystery: the behaviour of the shadow sequence when the given functions have disjoint domains. Building on previous work, we establish for the first time weak and value convergence of the shadow sequence generated by the Douglas-Rachford algorithm in a setting of unprecedented generality. The weak limit point is shown to solve the associated normal problem which is a minimal perturbation of the original optimization problem. We also present new results on the geometry of the minimal displacement vector.


title: Adaptive Learning Rate and Momentum for Training Deep Neural Networks

abstract: Recent progress on deep learning relies heavily on the quality and efficiency of training algorithms. In this paper, we develop a fast training method motivated by the nonlinear Conjugate Gradient (CG) framework. We propose the Conjugate Gradient with Quadratic line-search (CGQ) method. On the one hand, a quadratic line-search determines the step size according to current loss landscape. On the other hand, the momentum factor is dynamically updated in computing the conjugate gradient parameter (like Polak-Ribiere). Theoretical results to ensure the convergence of our method in strong convex settings is developed. And experiments in image classification datasets show that our method yields faster convergence than other local solvers and has better generalization capability (test set accuracy). One major advantage of the paper method is that tedious hand tuning of hyperparameters like the learning rate and momentum is avoided.


title: Winning the CVPR'2021 Kinetics-GEBD Challenge: Contrastive Learning Approach

abstract: Generic Event Boundary Detection (GEBD) is a newly introduced task that aims to detect "general" event boundaries that correspond to natural human perception. In this paper, we introduce a novel contrastive learning based approach to deal with the GEBD. Our intuition is that the feature similarity of the video snippet would significantly vary near the event boundaries, while remaining relatively the same in the remaining part of the video. In our model, Temporal Self-similarity Matrix (TSM) is utilized as an intermediate representation which takes on a role as an information bottleneck. With our model, we achieved significant performance boost compared to the given baselines. Our code is available at https://github.com/hello-jinwoo/LOVEU-CVPR2021.


title: Au12@Au30: Core-Shell Molecule Constituted of an Icosahedron and an Icosidodecahedron

abstract: A stable core-shell structure with Ih symmetry, Au12@Au30, has been investigated by first-principles calculations. It is composed of an icosahedron core and an icosidodecahedron shell. The stability of the core-shell Au42 structure is verified by vibrational frequency analysis and molecular dynamics NVT simulations. Both the frontier molecular orbitals and the spin density of states show obvious s-d hybridization characteristics. The adaptive natural density partitioning analysis demonstrate multi-center bonds, twenty 6-center {\sigma} bonds ,and one 12-center {\sigma} bond, which are of great importance for the core-shell structural stability. In this core-shell nanostructure, there are also a large number of one-center valence lone electron pairs with the characteristics of d-like orbitals, so that the proposed Au12@Au30 could be used in medicine and catalysis fields.


title: Optimization of bus scheduling and bus-berth matching at curbside stops under connected vehicle environment

abstract: It is commonly seen that buses are blocked by the ones in front serving passengers and have to queue outside a curbside bus stop although there are vacant berths at the stop. The resultant bus delays degrade the service level of urban public transportation. A potential solution is to reschedule the arrivals of the buses at the stop for full utilization of the berths with the aid of connected vehicle technologies. This study proposes a mixed-integer linear programming model to optimize the scheduling of bus arrivals and the bus-berth matching at a curbside stop under connected vehicle environment. The objective is the minimization of the bus delays weighted by the number of passengers on the buses. Bus arrival times at the stop and the assignment of berths are optimized together with bus departure times from the stop. Bus punctuality is also taken into consideration. The proposed model could be applied dynamically to cater to time-varying traffic conditions. Numerical studies validate the advantages of the proposed model over the first-come-first-service strategy and the relaxed model without bus punctuality in terms of weighted bus delays and bus punctuality. Sensitivity analyses show that: 1) the proposed model is robust to the fluctuation of bus service time; and 2) a smaller number of berths may be preferred on condition that the bus demand does not exceed the stop capacity.


title: Finitely generated subgroups of free groups as formal languages and their cogrowth

abstract: For finitely generated subgroups $H$ of a free group $F_m$ of finite rank $m$, we study the language $L_H$ of reduced words that represent $H$ which is a regular language. Using the (extended) core of Schreier graph of $H$, we construct the minimal deterministic finite automaton that recognizes $L_H$. Then we characterize the f.g. subgroups $H$ for which $L_H$ is irreducible and for such groups explicitly construct ergodic automaton that recognizes $L_H$. This construction gives us an efficient way to compute the cogrowth series $L_H(z)$ of $H$ and entropy of $L_H$. Several examples illustrate the method and a comparison is made with the method of calculation of $L_H(z)$ based on the use of Nielsen system of generators of $H$.


title: The kernel generating condition and absolute Galois groups

abstract: For a list $\cal{L}$ of finite groups and for a profinite group $G$, we consider the intersection $T(G)$ of all open normal subgroups $N$ of $G$ with $G/N$ in $\cal{L}$. We give a cohomological characterization of the epimorphisms $\pi\colon S\to G$ of profinite groups (satisfying some additional requirements) such that $\pi[T(S)]=T(G)$. For $p$ prime, this is used to describe cohomologically the profinite groups $G$ whose $n$th term $G_{(n,p)}$ (resp., $G^{(n,p)}$) in the $p$-Zassenhaus filtration (resp., lower $p$-central filtration) is an intersection of this form. When $G=G_F$ is the absolute Galois group of a field $F$ containing a root of unity of order $p$, we recover as special cases results by Minac, Spira and the author, describing $G_{(3,p)}$ and $G^{(3,p)}$ as $T(G)$ for appropriate lists $\cal{L}$.


title: Subbotin Graphical Models for Extreme Value Dependencies with Applications to Functional Neuronal Connectivity

abstract: With modern calcium imaging technology, activities of thousands of neurons can be recorded in vivo. These experiments can potentially provide new insights into intrinsic functional neuronal connectivity, defined as contemporaneous correlations between neuronal activities. As a common tool for estimating conditional dependencies in high-dimensional settings, graphical models are a natural choice for estimating functional connectivity networks. However, raw neuronal activity data presents a unique challenge: the relevant information in the data lies in rare extreme value observations that indicate neuronal firing, rather than in the observations near the mean. Existing graphical modeling techniques for extreme values rely on binning or thresholding observations, which may not be appropriate for calcium imaging data. In this paper, we develop a novel class of graphical models, called the Subbotin graphical model, which finds sparse conditional dependency structures with respect to the extreme value observations without requiring data pre-processing. We first derive the form of the Subbotin graphical model and show the conditions under which it is normalizable. We then study the empirical performance of the Subbotin graphical model and compare it to existing extreme value graphical modeling techniques and functional connectivity models from neuroscience through several simulation studies as well as a real-world calcium imaging data example.


title: Laser propagation in Rindler accelerated reference frame based on matrix optics

abstract: The Rindler spacetime describing a series of accelerating observers is Ricci flat, but it still has novel optical effects. In the case of WKB approximation, we derive the light geodesics in the Rindler frame based on the covariant wave equation and geodesic equations. Then, we use ABCD matrix optics method to explore the propagation characteristics of Rindler frame, thus link three different optical transformation scenes (geometry, gravity and vacuum refractive index) together. Moreover, the propagation characteristics of hollow beam in Rindler spacetime are described analytically. Those characteristics are quite different from the ones in the flat spacetime. Based on these calculations, we simply demonstrate the position uncertain relationship between the transverse beam size and the momentum, which surprisingly coincides with the derivation of quantization. We hope that we can provide one simple method to analyze the beam propagation in the accelerated frame.


title: Uniqueness of Yudovich's solutions to the 2D incompressible Euler equation despite the presence of sources and sinks

abstract: In $1962$, Yudovich proved the existence and uniqueness of classical solutions to the 2D incompressible Euler equations in the case where the fluid occupies a bounded domain with entering and exiting flows on some parts of the boundary. The normal velocity is prescribed on the whole boundary, as well as the entering vorticity. The uniqueness part of Yudovich's result holds for H\"older vorticity, by contrast with his 1961 result on the case of an impermeable boundary, for which the normal velocity is prescribed as zero on the boundary, and for which the assumption that the initial vorticity is bounded was shown to be sufficient to guarantee uniqueness. Whether or not uniqueness holds as well for bounded vorticities in the case of entering and exiting flows has been left open until $2014$, when Weigant and Papin succeeded to tackle the case where the domain is a rectangle. In this paper we adapt Weigant and Papin's result to the case of a smooth domain with several internal sources and sinks.


title: Few-cycle mid-infrared pulses from BaGa2GeSe6

abstract: BGGSe is a newly developed nonlinear material that is attractive for ultrabroad frequency mixing and ultrashort pulse generation due to its comparably low dispersion and high damage threshold.In a first experiment, we show that a long crystal length of 2.6 mm yields a pulse energy of 21 pJ at 100 MHz with a spectral bandwidth covering 5.8 to 8.5 microns. The electric field of the carrier-envelope-phase stable pulse is directly measured with electro-optical sampling and reveals a pulse duration of 91 fs, which corresponds to sub-four optical cycles, thus confirming some of the prospects of the material for ultrashort pulse generation and mid-infrared spectroscopy.


title: Learning-Based Practical Light Field Image Compression Using A Disparity-Aware Model

abstract: Light field technology has increasingly attracted the attention of the research community with its many possible applications. The lenslet array in commercial plenoptic cameras helps capture both the spatial and angular information of light rays in a single exposure. While the resulting high dimensionality of light field data enables its superior capabilities, it also impedes its extensive adoption. Hence, there is a compelling need for efficient compression of light field images. Existing solutions are commonly composed of several separate modules, some of which may not have been designed for the specific structure and quality of light field data. This increases the complexity of the codec and results in impractical decoding runtimes. We propose a new learning-based, disparity-aided model for compression of 4D light field images capable of parallel decoding. The model is end-to-end trainable, eliminating the need for hand-tuning separate modules and allowing joint learning of rate and distortion. The disparity-aided approach ensures the structural integrity of the reconstructed light fields. Comparisons with the state of the art show encouraging performance in terms of PSNR and MS-SSIM metrics. Also, there is a notable gain in the encoding and decoding runtimes. Source code is available at https://moha23.github.io/LF-DAAE.


title: Hand-Drawn Electrical Circuit Recognition using Object Detection and Node Recognition

abstract: With the recent developments in neural networks, there has been a resurgence in algorithms for the automatic generation of simulation ready electronic circuits from hand-drawn circuits. However, most of the approaches in literature were confined to classify different types of electrical components and only a few of those methods have shown a way to rebuild the circuit schematic from the scanned image, which is extremely important for further automation of netlist generation. This paper proposes a real-time algorithm for the automatic recognition of hand-drawn electrical circuits based on object detection and circuit node recognition. The proposed approach employs You Only Look Once version 5 (YOLOv5) for detection of circuit components and a novel Hough transform based approach for node recognition. Using YOLOv5 object detection algorithm, a mean average precision (mAP0.5) of 98.2% is achieved in detecting the components. The proposed method is also able to rebuild the circuit schematic with 80% accuracy with a near-real time performance of 0.33s per schematic generation.


title: Finding Valid Adjustments under Non-ignorability with Minimal DAG Knowledge

abstract: Treatment effect estimation from observational data is a fundamental problem in causal inference. There are two very different schools of thought that have tackled this problem. On one hand, Pearlian framework commonly assumes structural knowledge (provided by an expert) in form of directed acyclic graphs and provides graphical criteria such as back-door criterion to identify valid adjustment sets. On other hand, potential outcomes (PO) framework commonly assumes that all observed features satisfy ignorability (i.e., no hidden confounding), which in general is untestable. In prior works that attempted to bridge these frameworks, there is an observational criteria to identify an anchor variable and if a subset of covariates (not involving the anchor variable) passes a suitable conditional independence criteria, then that subset is a valid back-door. Our main result strengthens these prior results by showing that under a different expert-driven structural knowledge -- that one variable is a direct causal parent of treatment variable -- remarkably, testing for subsets (not involving the known parent variable) that are valid back-doors is equivalent to an invariance test. Importantly, we also cover the non-trivial case where entire set of observed features is not ignorable (generalizing the PO framework) without requiring knowledge of all parents of treatment variable. Our key technical idea involves generation of a synthetic sub-sampling (or environment) variable that is a function of the known parent variable. In addition to designing an invariance test, this sub-sampling variable allows us to leverage Invariant Risk Minimization, and thus, connects finding valid adjustments (in non-ignorable observational setting) to representation learning. We demonstrate effectiveness and tradeoffs of our approaches on a variety of synthetic data as well as real causal effect estimation benchmarks.


title: Discrepancy-based Inference for Intractable Generative Models using Quasi-Monte Carlo

abstract: Intractable generative models are models for which the likelihood is unavailable but sampling is possible. Most approaches to parameter inference in this setting require the computation of some discrepancy between the data and the generative model. This is for example the case for minimum distance estimation and approximate Bayesian computation. These approaches require sampling a high number of realisations from the model for different parameter values, which can be a significant challenge when simulating is an expensive operation. In this paper, we propose to enhance this approach by enforcing "sample diversity" in simulations of our models. This will be implemented through the use of quasi-Monte Carlo (QMC) point sets. Our key results are sample complexity bounds which demonstrate that, under smoothness conditions on the generator, QMC can significantly reduce the number of samples required to obtain a given level of accuracy when using three of the most common discrepancies: the maximum mean discrepancy, the Wasserstein distance, and the Sinkhorn divergence. This is complemented by a simulation study which highlights that an improved accuracy is sometimes also possible in some settings which are not covered by the theory.


title: SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning

abstract: This paper introduces a solid state-of-the-art baseline for a class-incremental semantic segmentation (CISS) problem. While the recent CISS algorithms utilize variants of the knowledge distillation (KD) technique to tackle the problem, they failed to fully address the critical challenges in CISS causing the catastrophic forgetting; the semantic drift of the background class and the multi-label prediction issue. To better address these challenges, we propose a new method, dubbed SSUL-M (Semantic Segmentation with Unknown Label with Memory), by carefully combining techniques tailored for semantic segmentation. Specifically, we claim three main contributions. (1) defining unknown classes within the background class to help to learn future classes (help plasticity), (2) freezing backbone network and past classifiers with binary cross-entropy loss and pseudo-labeling to overcome catastrophic forgetting (help stability), and (3) utilizing tiny exemplar memory for the first time in CISS to improve both plasticity and stability. The extensively conducted experiments show the effectiveness of our method, achieving significantly better performance than the recent state-of-the-art baselines on the standard benchmark datasets. Furthermore, we justify our contributions with thorough ablation analyses and discuss different natures of the CISS problem compared to the traditional class-incremental learning targeting classification. The official code is available at https://github.com/clovaai/SSUL.


title: Creating A New Color Space utilizing PSO and FCM to Perform Skin Detection by using Neural Network and ANFIS

abstract: Skin color detection is an essential required step in various applications related to computer vision. These applications will include face detection, finding pornographic images in movies and photos, finding ethnicity, age, diagnosis, and so on. Therefore, proposing a proper skin detection method can provide solution to several problems. In this study, first a new color space is created using FCM and PSO algorithms. Then, skin classification has been performed in the new color space utilizing linear and nonlinear modes. Additionally, it has been done in RGB and LAB color spaces by using ANFIS and neural network. Skin detection in RBG color space has been performed using Mahalanobis distance and Euclidean distance algorithms. In comparison, this method has 18.38% higher accuracy than the most accurate method on the same database. Additionally, this method has achieved 90.05% in equal error rate (1-EER) in testing COMPAQ dataset and 92.93% accuracy in testing Pratheepan dataset, which compared to the previous method on COMPAQ database, 1-EER has increased by %0.87.


title: Realisation of bending measured laminations by Kleinian surface groups

abstract: For geometrically finite Kleinian surface groups, Bonahon and Otal proved the existence part, and partly the uniqueness part of the bending lamination conjecture. In this paper, we generalise the existence part to general Kleinian surface groups including geometrically infinite ones. We furthermore prove the compactness of the set of Kleinian surface groups realising an arbitrarily fixed data of bending laminations and ending laminations. Our proof is independent of that of Bonahon and Otal.


title: Practical Near Neighbor Search via Group Testing

abstract: We present a new algorithm for the approximate near neighbor problem that combines classical ideas from group testing with locality-sensitive hashing (LSH). We reduce the near neighbor search problem to a group testing problem by designating neighbors as "positives," non-neighbors as "negatives," and approximate membership queries as group tests. We instantiate this framework using distance-sensitive Bloom Filters to Identify Near-Neighbor Groups (FLINNG). We prove that FLINNG has sub-linear query time and show that our algorithm comes with a variety of practical advantages. For example, FLINNG can be constructed in a single pass through the data, consists entirely of efficient integer operations, and does not require any distance computations. We conduct large-scale experiments on high-dimensional search tasks such as genome search, URL similarity search, and embedding search over the massive YFCC100M dataset. In our comparison with leading algorithms such as HNSW and FAISS, we find that FLINNG can provide up to a 10x query speedup with substantially smaller indexing time and memory.


title: SENT: Sentence-level Distant Relation Extraction via Negative Training

abstract: Distant supervision for relation extraction provides uniform bag labels for each sentence inside the bag, while accurate sentence labels are important for downstream applications that need the exact relation type. Directly using bag labels for sentence-level training will introduce much noise, thus severely degrading performance. In this work, we propose the use of negative training (NT), in which a model is trained using complementary labels regarding that ``the instance does not belong to these complementary labels". Since the probability of selecting a true label as a complementary label is low, NT provides less noisy information. Furthermore, the model trained with NT is able to separate the noisy data from the training data. Based on NT, we propose a sentence-level framework, SENT, for distant relation extraction. SENT not only filters the noisy data to construct a cleaner dataset, but also performs a re-labeling process to transform the noisy data into useful training data, thus further benefiting the model's performance. Experimental results show the significant improvement of the proposed method over previous methods on sentence-level evaluation and de-noise effect.


title: Tunable Graphene-based Pulse Compressor for Terahertz Application

abstract: Pulse shaping is important for communications, spectroscopy, and other applications that require high peak power and pulsed operation, such as radar systems. Unfortunately, pulse shaping remains largely elusive for terahertz (THz) frequencies. To address this void, a comprehensive study on the dispersion tunability properties of THz chirped pulses traveling through a dielectric-lined hollow-core waveguide loaded with a helical graphene ribbon is presented.